-- Logs begin at Mon 2022-05-16 16:53:08 UTC, end at Mon 2022-05-16 18:00:49 UTC. -- May 16 17:25:14.583373 dv-cinder-837699-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 17:25:14 2022] *** May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: nodename: dv-cinder-837699-6-iscsi May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: machine: x86_64 May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: clock source: unix May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: pcre jit disabled May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: detected number of CPU cores: 4 May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: current working directory: / May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: detected binary path: /usr/bin/uwsgi-core May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: your processes number limit is 47680 May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: your memory page size is 4096 bytes May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: detected max file descriptor number: 2048 May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: lock engine: pthread robust mutexes May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: thunder lock: enabled May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 17:25:14.605312 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 17:25:14.644949 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: Python main interpreter initialized at 0x56089c3069c0 May 16 17:25:14.644949 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: python threads support enabled May 16 17:25:14.644949 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: your server socket listen backlog is limited to 100 connections May 16 17:25:14.644949 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: your mercy for graceful operations on workers is 90 seconds May 16 17:25:14.645302 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: mapped 403077 bytes (393 KB) for 2 cores May 16 17:25:14.645502 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: *** Operational MODE: preforking *** May 16 17:25:14.645724 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: *** uWSGI is running in multiple interpreter mode *** May 16 17:25:14.645724 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: spawned uWSGI master process (pid: 79977) May 16 17:25:14.645920 dv-cinder-837699-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 17:25:14.651751 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: spawned uWSGI worker 1 (pid: 80037, cores: 1) May 16 17:25:14.651751 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: spawned uWSGI worker 2 (pid: 80038, cores: 1) May 16 17:25:14.651751 dv-cinder-837699-6-iscsi devstack@keystone.service[79977]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 17:25:20.286854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:25:20.286854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: from cryptography.utils import int_from_bytes May 16 17:25:20.287614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:25:20.287614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: from cryptography.utils import int_from_bytes May 16 17:25:20.288189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:25:20.288189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: from cryptography.utils import int_from_bytes May 16 17:25:20.288337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:25:20.288337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: from cryptography.utils import int_from_bytes May 16 17:25:20.336288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 17:25:20.336452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 17:25:20.336536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 17:25:20.336618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] command line args: [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 17:25:20.336690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 17:25:20.336905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] command line args: [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 17:25:20.336986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 17:25:20.337053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ================================================================================ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 17:25:20.337116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 17:25:20.337307 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] admin_token = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.337404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ================================================================================ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 17:25:20.337471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_dir = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.337536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] admin_token = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.337747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.337820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] config_dir = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.337880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_source = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.337947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.338012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] debug = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.338193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] config_source = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.338274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.340630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] debug = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.340630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.340799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.340799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.340912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.340912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_config_append = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_config_append = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_dir = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_dir = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_file = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.341947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.342979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] publish_errors = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.343950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.344707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.344928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] publish_errors = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.345093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.345283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.345476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.345713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.345873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.346105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.346401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.346566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.346756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] standard_threads = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.346959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.347183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.347347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] standard_threads = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.347535 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.347724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.347919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.348116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.348340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_journal = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.348508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.348699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_json = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.348894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_journal = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.349091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_stderr = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.349281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_json = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.349480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_syslog = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.349658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_stderr = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.349800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.349963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_syslog = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.350091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.350250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:25:20.350393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.350523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.350651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.350785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.350947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.351106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.351246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.351382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.351517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.351663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.351799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.352004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.352134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.352261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.352387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.352514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.352641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.352777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.352913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.353041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.353169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.353295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.353438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.354684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.354822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.354928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.355042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.355284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.355403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.355519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.355616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.355717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.355814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.355957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.356318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.356477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.356608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.356735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.356869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.356996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.357125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.357259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.357395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.357540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.357705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.357861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.357991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.358128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.358257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.358395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.358524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.358652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.358788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.358928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.359059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.359187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.359327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.359459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.359587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.360039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.360179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.360179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.360442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.360442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.360689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.360831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.361043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.361204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.361336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.361463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.361659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.361807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.361942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.361942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.362189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.362317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.362464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.362593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.362720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.362846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.362973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.363106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.363246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.363375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.363503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.363637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.363781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.363970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.364155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.365489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.365686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.365880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.366112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.366277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.366504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.366677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.366867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.367056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.367244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.367447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.367673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.367838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.368091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.368306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.368472 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.368663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.368887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.369052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.369247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.369437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.369692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.369892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.370091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.370261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.370451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.370613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.370785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.370916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.371086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.371224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.371384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.371525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.371663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.371794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.371923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.372090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.372224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.372360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.372497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.372636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.372765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.372893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.373030 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.373159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.373293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.373452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.373629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.373764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.373909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.374046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.374175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.374308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.374443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.374583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.374720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.374849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.375049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.375185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.375320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.375457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.375605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.375734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.375861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.375990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.376153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.376316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.376520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.376663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.376792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.376922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.377050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.377177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.377314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.377444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.377611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.377746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.377874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.378035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.378247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.378409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.378559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.378689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.378689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.378938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.379067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.379195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.379323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.379450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.379580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.379715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.379852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.379992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.380120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.380249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.380386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.380515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.380643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.380779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.380907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.381035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.381162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.381290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.381417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.381570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.381717 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.381853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.381982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.382115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.382254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.382391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.382520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.382648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.382776 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.382903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.383030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.external = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.383166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.383296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.383423 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.383551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.383688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.383823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.383969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.external = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.384131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.password = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.384273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.384404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.token = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.384533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.384671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.384801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.384930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.385067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.password = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.385197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.385325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.token = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.385460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.385627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.385772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.385914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.386044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.386173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.386303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.386431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.386569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.386699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.386828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.386956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.387085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.387213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.387361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.387492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.387636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.387765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.387900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.388029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.388167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.388296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.388425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.388554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.388683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.388816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.388955 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.389085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.389214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.389348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.389489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.389676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.389822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.389954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.390083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.390212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.390342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.390470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.390607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.390738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.390867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.391002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.391131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.391283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.391421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.391550 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.391679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.391808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.391937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.392065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.392267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.392400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.392530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.392667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.392797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.392926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.393062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.393202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.393332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.393460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.393622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.393756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.393897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.394027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.394156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.394284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.394412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.394539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.394677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.394809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.394956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.395991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.396243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.396373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.396501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.396501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.396753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.396889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.397029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.397164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.397295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.397423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.397611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.397758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.397967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.398101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.398230 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.398359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.398488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.398634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.398765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.398765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.399009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.399009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.399252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.399390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.399520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.399649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.399777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.399906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.400041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.400179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.400309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.400447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.400577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.400705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.400834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.400969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.401100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.401229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.401357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.401492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.401667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.401806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.401936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.402064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.402204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.402333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.402462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.402599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.402728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.402856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.402984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.403112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.403242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.403379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.403507 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.403701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.403861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.404001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.404141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.404280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.404411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.404540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.404668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.404796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.404925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.405062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.405191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.405321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.405450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.405615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.405750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.405891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.406032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.406245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.406379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.406509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.406638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.406777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.406907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.407036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.407164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.407295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.407463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.407611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.407744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.407873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.408011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.408141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.408337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.408476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.408608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.408736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.408865 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.408994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.409123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.409259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.409390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.409519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.409694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.409835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.409966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.410106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.410236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.410365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.410365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.410611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.410747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.410884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.411014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.411143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.411272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.411400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.411537 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.411678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.411678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.411922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.412051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.412180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.412317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.412447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.412581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.412711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.412840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.412968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.413106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.413242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.413242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.413496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.413659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.413790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.413930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.414066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.414196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.414325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.414453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.414582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.414719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.414849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.414977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.415106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.415248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.415377 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.415519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.415652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.415781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.415910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.416044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.416173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.416311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.416440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.416569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.416697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.416825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.416956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.417102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.417232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.417361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.417490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.417651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.417792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.418000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.418133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.418262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.418391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.418521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.418650 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.418786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.418927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.419057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.419185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.419313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.419442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.419580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.419710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.419839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.419967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.420098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.420226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.420363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.420492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.420622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.420761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.420891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.421019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.421156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.421286 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.421415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.421787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.421945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.422078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] role.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.422221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.422352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] role.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.422481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.422610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.422739 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.422878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.423017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.423148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.423285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.423415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.423544 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.423672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.423810 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.423940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.424070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.424201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.424331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.424469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.424609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.424739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.424739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.424981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.425111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.425248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.425379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.425514 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.425701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.425837 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.425967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.426109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.426109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.426367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.426497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.426626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.426755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.426892 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.427023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.427460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.427639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.427861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.428044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.428249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.428457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.428667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.428881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.429084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.429299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.429503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.429663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.429794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.429924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.430053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.430182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.430323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.430462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.430598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.430735 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.430870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.431016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.431161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.431297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.431432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.431570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.431705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.431840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.431984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.432121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.432256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.432390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.432525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.432670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.432818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.432953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.433088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.433223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.433358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.433501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.433705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.433843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.433978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.434113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.434113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.434382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.434519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.434653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.434800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.434936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.435072 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.435221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.435358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.435500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.435500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.435765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.435900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.436045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.436190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.436338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.436475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.436611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.436757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.436893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.437028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.437173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.437311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.437533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.437533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.437831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.437995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.438147 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.438292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.438430 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.438567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.438703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.438850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.438988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.439132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.439270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.439412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.439549 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.439684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.439824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.439969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.440115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.440251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.440459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.440610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.440764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.440979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 17:25:20.441706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:25:20.441706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 17:25:20.448293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.448502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.448653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.448793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.448932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.449084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.458250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.458875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.486405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.486628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.487328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.487556 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.538530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.540527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.588959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.589153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.590489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.590720 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.653577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.653810 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.653903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.654863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.678238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.678395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.678480 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.678565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.678640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.678759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.678844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.679048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.679138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.679291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.679418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.679498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.679595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.679674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.690766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.690896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.705375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.705584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.705673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.705751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.705826 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.705915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.706028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.706135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.706240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.706316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.706389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.706463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.706638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.706768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 17:25:20.723930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.724055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 17:25:20.724136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.724315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 17:25:20.724439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.724552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 17:25:20.724640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.724817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 17:25:20.724940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.725036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.725115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.725304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.725430 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.725512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.725635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.725811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.736444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.736670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.736798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.736912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.737019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.737200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.737326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.737451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.745243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.745447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.748494 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.748706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.748832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.748947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.749054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.749240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.749367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.749648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.749774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.749940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.750085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.750170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.750234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.750427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.750553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.750647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.750725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.750925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.751051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.751158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.751258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.751439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.777378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.777538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.778973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.779201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.779332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.779414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.784470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.784597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.784711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.784891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.785017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.785131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.792193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.792319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.792452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.792544 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.797088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.797215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.797373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.797499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.797636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.797719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.797940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.798067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.798178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.798280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.798470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.798597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.798711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.798800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.798997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.799123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.817767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.817893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.818008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.818097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.822480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.822605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.826018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.826146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.826305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.826450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.831254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.831381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.834780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.834907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.838453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.838580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.838741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.838866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.838978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.839155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.839236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.839299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.839522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.839648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.839744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.839822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.858594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.858721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.858952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.859096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.859180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.859281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.859524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.859687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.867297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.867444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.868976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.869102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.869227 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.869318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.872239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.872364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.872490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.872582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.872784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.872911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.873012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.873092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.873307 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.873433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.889949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.890221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.890412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.890595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.890767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.890917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.891007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.891084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.891309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.891437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.891533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.891612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.891852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.892118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.909512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.910150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.912733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.913388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.916010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.916679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.917612 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.918296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.919224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.919496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.919767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.919893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.920168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.920449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.927745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.928377 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.929351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.930036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.932647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.932935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.933205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.933331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.933447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.933588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.933866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.934136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.942791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.943082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.943347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.943473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.943710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.943989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.951296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.951573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.951845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.951970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 17:25:20.952089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.952218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.952348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.952490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.952653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.952782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.952864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.953111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.953267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.953399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.953527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.953707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.953896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.954030 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.954157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.954281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.954439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.954567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.954703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.954831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.954957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.955205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.955205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.955485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 17:25:20.993186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56089c3069c0 pid: 80037 (default app) May 16 17:25:20.993873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56089c3069c0 pid: 80038 (default app) May 16 17:25:20.996751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3de8-d464-4463-964e-ded36c58fe48 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:20.997046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3de8-d464-4463-964e-ded36c58fe48 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:20.997328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3de8-d464-4463-964e-ded36c58fe48 None None] PATH_INFO: `/v3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:21.001631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Mon May 16 17:25:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:28.900575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc235e2-87ee-4641-8acc-3169da499731 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:28.901157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc235e2-87ee-4641-8acc-3169da499731 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:28.901157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc235e2-87ee-4641-8acc-3169da499731 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:28.905470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:28.911011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:28.911472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:28.911557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:28.942626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG oslo_db.sqlalchemy.engines [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:25:29.124823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG passlib.handlers.bcrypt [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80037) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 17:25:29.125239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG passlib.handlers.bcrypt [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80037) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 17:25:29.181431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:29.182987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:29.310861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 17:25:29.489265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc235e2-87ee-4641-8acc-3169da499731 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:29.525008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG oslo_db.sqlalchemy.engines [None req-fbc235e2-87ee-4641-8acc-3169da499731 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:25:29.651240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc235e2-87ee-4641-8acc-3169da499731 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:29.656006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af78db6-9416-42a7-aad7-391fbd61640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:29.656670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af78db6-9416-42a7-aad7-391fbd61640d admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:29.656952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af78db6-9416-42a7-aad7-391fbd61640d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:29.657225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af78db6-9416-42a7-aad7-391fbd61640d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:29.665583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af78db6-9416-42a7-aad7-391fbd61640d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:29.716405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3af78db6-9416-42a7-aad7-391fbd61640d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 17:25:29.716735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af78db6-9416-42a7-aad7-391fbd61640d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:29.726543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Mon May 16 17:25:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:25:29.732573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:29.747041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261d645-a606-4ec2-8351-d5e25ba4c4b6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:29.751920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66769ac7-dbb6-467c-83b1-22ee9518fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:29.753041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769ac7-dbb6-467c-83b1-22ee9518fbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:29.753321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769ac7-dbb6-467c-83b1-22ee9518fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:29.753583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769ac7-dbb6-467c-83b1-22ee9518fbb1 admin admin] PATH_INFO: `/v3/projects/ab7c1a113cb54758aa563ff3298e430c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:29.755157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66769ac7-dbb6-467c-83b1-22ee9518fbb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab7c1a113cb54758aa563ff3298e430c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:29.804567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING keystone.common.rbac_enforcer.enforcer [None req-66769ac7-dbb6-467c-83b1-22ee9518fbb1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 17:25:29.804906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66769ac7-dbb6-467c-83b1-22ee9518fbb1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:29.809575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Mon May 16 17:25:29 2022] GET /identity/v3/projects/ab7c1a113cb54758aa563ff3298e430c => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:31.991260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1da1-8ac5-4674-9073-b43407e99707 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:31.991853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1da1-8ac5-4674-9073-b43407e99707 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:31.991853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1da1-8ac5-4674-9073-b43407e99707 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:31.995893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:25:32.002673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaf96b-0c6a-4197-a633-feeeeb1d258e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:32.003402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaf96b-0c6a-4197-a633-feeeeb1d258e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:32.003562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaf96b-0c6a-4197-a633-feeeeb1d258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:32.029758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-47eaf96b-0c6a-4197-a633-feeeeb1d258e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:32.031257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-47eaf96b-0c6a-4197-a633-feeeeb1d258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:32.040253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 17:25:32.063295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d1da1-8ac5-4674-9073-b43407e99707 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:32.077034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d1da1-8ac5-4674-9073-b43407e99707 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:32.082587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51031f-45a6-4aab-91e0-588067e96f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:32.083219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51031f-45a6-4aab-91e0-588067e96f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:32.083496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51031f-45a6-4aab-91e0-588067e96f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:32.083763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51031f-45a6-4aab-91e0-588067e96f0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:32.092236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51031f-45a6-4aab-91e0-588067e96f0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:32.094114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51031f-45a6-4aab-91e0-588067e96f0a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:32.103189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Mon May 16 17:25:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:25:32.109259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaf96b-0c6a-4197-a633-feeeeb1d258e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:32.119005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaf96b-0c6a-4197-a633-feeeeb1d258e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:32.125363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbf55b-0f01-455c-9051-dea124448bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:32.126240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf55b-0f01-455c-9051-dea124448bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:32.126516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf55b-0f01-455c-9051-dea124448bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:32.126781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf55b-0f01-455c-9051-dea124448bc3 admin admin] PATH_INFO: `/v3/users/4463e4c93e664f46a81171f07eadb93c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:32.128370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbf55b-0f01-455c-9051-dea124448bc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=4463e4c93e664f46a81171f07eadb93c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:32.130257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbf55b-0f01-455c-9051-dea124448bc3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:32.131802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Mon May 16 17:25:32 2022] GET /identity/v3/users/4463e4c93e664f46a81171f07eadb93c => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:34.402026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803e6b-c555-4262-b504-c0fdcee0f25c None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:34.402577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803e6b-c555-4262-b504-c0fdcee0f25c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:34.402577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803e6b-c555-4262-b504-c0fdcee0f25c None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:34.403895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69c47-f933-4f84-9bd3-cd88c9e962bc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:34.404312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:34.404398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69c47-f933-4f84-9bd3-cd88c9e962bc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:34.404398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69c47-f933-4f84-9bd3-cd88c9e962bc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:34.405906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:25:34.408997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:34.409278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:34.409573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:34.410773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58994f-93af-43f4-826d-c302a4f0048e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:34.411057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58994f-93af-43f4-826d-c302a4f0048e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:34.411326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58994f-93af-43f4-826d-c302a4f0048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:34.452319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG passlib.handlers.bcrypt [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80038) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 17:25:34.452887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG passlib.handlers.bcrypt [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80038) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 17:25:34.499595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:34.501290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:34.537320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3c58994f-93af-43f4-826d-c302a4f0048e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:34.538550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3c58994f-93af-43f4-826d-c302a4f0048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:34.618305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:34.620524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:25:34.640330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:34.643210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58994f-93af-43f4-826d-c302a4f0048e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:34.735498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf4b1-34e2-4185-a58b-39756b74f78f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:34.741579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58994f-93af-43f4-826d-c302a4f0048e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:34.767398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61bb22-4e0d-4e7b-b25f-e9689438746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:34.768220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61bb22-4e0d-4e7b-b25f-e9689438746b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:34.768498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61bb22-4e0d-4e7b-b25f-e9689438746b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:34.768770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61bb22-4e0d-4e7b-b25f-e9689438746b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:34.775053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada3391-3299-4a4f-9e39-f6a07951b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:34.775844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada3391-3299-4a4f-9e39-f6a07951b67e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:34.776128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada3391-3299-4a4f-9e39-f6a07951b67e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:34.776407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada3391-3299-4a4f-9e39-f6a07951b67e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:34.787269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada3391-3299-4a4f-9e39-f6a07951b67e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-dada3391-3299-4a4f-9e39-f6a07951b67e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:34.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:34.799429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:25:34.800285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 8/14] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:34.805776 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada3391-3299-4a4f-9e39-f6a07951b67e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:34.832415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61bb22-4e0d-4e7b-b25f-e9689438746b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:34.833965 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61bb22-4e0d-4e7b-b25f-e9689438746b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:34.902051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada3391-3299-4a4f-9e39-f6a07951b67e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:34.929812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 7/15] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:25:34.935459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61bb22-4e0d-4e7b-b25f-e9689438746b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:34.935948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:34.936615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:34.936870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:34.937180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:34.937969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:34.938279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:34.939675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:34.952334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 9/16] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:34.958386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:35.068759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98eebd-7862-4904-ae05-1c8836e0bf31 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:35.104670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9651cb8-6dd6-40a8-8276-da6773c1cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:35.105531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9651cb8-6dd6-40a8-8276-da6773c1cef3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:35.105877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9651cb8-6dd6-40a8-8276-da6773c1cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:35.106144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9651cb8-6dd6-40a8-8276-da6773c1cef3 None admin] PATH_INFO: `/v3/users/4463e4c93e664f46a81171f07eadb93c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:35.107296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9651cb8-6dd6-40a8-8276-da6773c1cef3 None admin] RBAC: Authorizing `identity:get_user(user_id=4463e4c93e664f46a81171f07eadb93c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:35.108778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9651cb8-6dd6-40a8-8276-da6773c1cef3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:35.110657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 10/17] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:34 2022] GET /identity/v3/users/4463e4c93e664f46a81171f07eadb93c => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:35.115871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9651cb8-6dd6-40a8-8276-da6773c1cef3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:35.151066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61bb22-4e0d-4e7b-b25f-e9689438746b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:35.183331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:35.184126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:35.184407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:35.184682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:35.202539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:35.204073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:35.209846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9651cb8-6dd6-40a8-8276-da6773c1cef3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:25:35.224385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:35.225233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:35.226084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:25:35.226084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:25:35.226084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:25:35.226084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:35.226084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 8/18] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:35.231587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:35.243654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c40e1-9981-413b-aac0-448a372152b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:35.244455 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c40e1-9981-413b-aac0-448a372152b7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:35.244737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c40e1-9981-413b-aac0-448a372152b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:35.245008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c40e1-9981-413b-aac0-448a372152b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:35.246226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c40e1-9981-413b-aac0-448a372152b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:35.247678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c40e1-9981-413b-aac0-448a372152b7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:35.249283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 11/19] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:35.254956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c40e1-9981-413b-aac0-448a372152b7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:35.327951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651c65-f490-4f0a-9de4-a5c7b0a1765b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:35.349817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c40e1-9981-413b-aac0-448a372152b7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:35.359127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af78f0-eec5-4553-a454-226eb9198922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:35.359783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af78f0-eec5-4553-a454-226eb9198922 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:35.360048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af78f0-eec5-4553-a454-226eb9198922 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:35.360313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af78f0-eec5-4553-a454-226eb9198922 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:35.361034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af78f0-eec5-4553-a454-226eb9198922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:35.361331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af78f0-eec5-4553-a454-226eb9198922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:35.362737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af78f0-eec5-4553-a454-226eb9198922 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:35.379374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 9/20] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:35.382651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d871-7167-407e-b360-f177f78cec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:35.383315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d871-7167-407e-b360-f177f78cec7e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:35.383600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d871-7167-407e-b360-f177f78cec7e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:35.383878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d871-7167-407e-b360-f177f78cec7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:35.384721 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d871-7167-407e-b360-f177f78cec7e None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.domain.id=default, user.id=4463e4c93e664f46a81171f07eadb93c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:35.385032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d871-7167-407e-b360-f177f78cec7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:35.386546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d871-7167-407e-b360-f177f78cec7e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:35.405581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 12/21] 10.222.0.58 () {56 vars in 1322 bytes} [Mon May 16 17:25:35 2022] GET /identity/v3/role_assignments?user.id=4463e4c93e664f46a81171f07eadb93c&scope.domain.id=default&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:37.812463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172ae4-260a-4b6e-a764-39733f732be7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:37.813018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172ae4-260a-4b6e-a764-39733f732be7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:37.813018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172ae4-260a-4b6e-a764-39733f732be7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:37.814891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 10/22] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:37.820160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999cbe4-493c-42af-a308-6a4eedd013dd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:37.820590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999cbe4-493c-42af-a308-6a4eedd013dd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:37.820708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999cbe4-493c-42af-a308-6a4eedd013dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:37.842982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9999cbe4-493c-42af-a308-6a4eedd013dd None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:37.844700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9999cbe4-493c-42af-a308-6a4eedd013dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:37.931830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 13/23] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:37.975359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e172ae4-260a-4b6e-a764-39733f732be7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:38.103087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29df70-106e-4bd7-a358-a919c2b560d7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.103377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29df70-106e-4bd7-a358-a919c2b560d7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.103565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29df70-106e-4bd7-a358-a919c2b560d7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.105052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 14/24] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:38.109785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e172ae4-260a-4b6e-a764-39733f732be7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:38.111010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b5c61-9115-4c36-a757-aaddd561c8f7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.111457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b5c61-9115-4c36-a757-aaddd561c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.111875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b5c61-9115-4c36-a757-aaddd561c8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.146770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2e5b5c61-9115-4c36-a757-aaddd561c8f7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:38.148261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2e5b5c61-9115-4c36-a757-aaddd561c8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:38.190291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292626a-e9a6-4b0a-8c1f-79645872aadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:38.191106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292626a-e9a6-4b0a-8c1f-79645872aadb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.191542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292626a-e9a6-4b0a-8c1f-79645872aadb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.191975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292626a-e9a6-4b0a-8c1f-79645872aadb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.223983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292626a-e9a6-4b0a-8c1f-79645872aadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1292626a-e9a6-4b0a-8c1f-79645872aadb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:38.241706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:38.242643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:38.243395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 11/25] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:38.251131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292626a-e9a6-4b0a-8c1f-79645872aadb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:38.282155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 15/26] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:38.322123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b5c61-9115-4c36-a757-aaddd561c8f7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:38.433048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292626a-e9a6-4b0a-8c1f-79645872aadb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:38.474332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b5c61-9115-4c36-a757-aaddd561c8f7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:38.476915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7248ef-f309-4474-8fe4-ad4b985b9520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:38.477623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7248ef-f309-4474-8fe4-ad4b985b9520 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.477907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7248ef-f309-4474-8fe4-ad4b985b9520 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.478183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7248ef-f309-4474-8fe4-ad4b985b9520 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.478943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7248ef-f309-4474-8fe4-ad4b985b9520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:38.479252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7248ef-f309-4474-8fe4-ad4b985b9520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:38.480651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7248ef-f309-4474-8fe4-ad4b985b9520 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:38.501494 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 12/27] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:38.503971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc89f-b3d0-4dc0-b3a9-be6beaeb18ec None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.504265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc89f-b3d0-4dc0-b3a9-be6beaeb18ec None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.504654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc89f-b3d0-4dc0-b3a9-be6beaeb18ec None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.506418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 13/28] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:38.510912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc89f-b3d0-4dc0-b3a9-be6beaeb18ec None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:38.515838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad76f23-2f91-4466-ab18-fbc512ef411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:38.516854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76f23-2f91-4466-ab18-fbc512ef411c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.517306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76f23-2f91-4466-ab18-fbc512ef411c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.517737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad76f23-2f91-4466-ab18-fbc512ef411c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.533443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad76f23-2f91-4466-ab18-fbc512ef411c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:38.535416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad76f23-2f91-4466-ab18-fbc512ef411c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cad76f23-2f91-4466-ab18-fbc512ef411c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:25:38.561590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:38.562568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:38.563443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:25:38.563443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:25:38.563443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:25:38.563443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:25:38.565433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 16/29] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:25:38.566986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58dae-e7d3-45b3-a550-ec3e005a43d1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.567336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58dae-e7d3-45b3-a550-ec3e005a43d1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.567674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58dae-e7d3-45b3-a550-ec3e005a43d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.586383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d5f58dae-e7d3-45b3-a550-ec3e005a43d1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:38.587539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d5f58dae-e7d3-45b3-a550-ec3e005a43d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:38.636718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc89f-b3d0-4dc0-b3a9-be6beaeb18ec None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:38.652327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 17/30] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:38.653787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc055d-f291-4e38-9c80-0a1dc471d2e8 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.654073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc055d-f291-4e38-9c80-0a1dc471d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.654353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc055d-f291-4e38-9c80-0a1dc471d2e8 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.659856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 18/31] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:38.659856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc055d-f291-4e38-9c80-0a1dc471d2e8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:38.674029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78691f-f81c-4e14-b95e-b9dbb93dfb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:38.675226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78691f-f81c-4e14-b95e-b9dbb93dfb81 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.675697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78691f-f81c-4e14-b95e-b9dbb93dfb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.676172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78691f-f81c-4e14-b95e-b9dbb93dfb81 None admin] PATH_INFO: `/v3/users/4463e4c93e664f46a81171f07eadb93c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.678262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78691f-f81c-4e14-b95e-b9dbb93dfb81 None admin] RBAC: Authorizing `identity:get_user(user_id=4463e4c93e664f46a81171f07eadb93c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:38.679915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78691f-f81c-4e14-b95e-b9dbb93dfb81 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:38.682094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 14/32] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:38 2022] GET /identity/v3/users/4463e4c93e664f46a81171f07eadb93c => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:38.687695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391145-e0a6-4486-94e0-226fbca7ad99 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.688527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391145-e0a6-4486-94e0-226fbca7ad99 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.689014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391145-e0a6-4486-94e0-226fbca7ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.705959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-76391145-e0a6-4486-94e0-226fbca7ad99 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:38.707526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-76391145-e0a6-4486-94e0-226fbca7ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:38.761100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc055d-f291-4e38-9c80-0a1dc471d2e8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:38.771931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 15/33] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:38.772977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391145-e0a6-4486-94e0-226fbca7ad99 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:38.814428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:38.815431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.815912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.816417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.817326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:38.817842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:38.819417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:38.837581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 19/34] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:38.839187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:38.888075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391145-e0a6-4486-94e0-226fbca7ad99 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:38.921157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7c5d8-9d3d-43ea-ae93-071b71190d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:38.922038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7c5d8-9d3d-43ea-ae93-071b71190d08 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.922326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7c5d8-9d3d-43ea-ae93-071b71190d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.922638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7c5d8-9d3d-43ea-ae93-071b71190d08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.923747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7c5d8-9d3d-43ea-ae93-071b71190d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:38.925399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7c5d8-9d3d-43ea-ae93-071b71190d08 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:38.931768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 16/35] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:38.931768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7c5d8-9d3d-43ea-ae93-071b71190d08 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:38.952545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0768-9fc8-4863-9537-f1b8144496c6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:38.994941 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b92a-e269-4830-aa3c-3ef3a8a013e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:38.996003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b92a-e269-4830-aa3c-3ef3a8a013e7 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:38.996483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b92a-e269-4830-aa3c-3ef3a8a013e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:38.997079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b92a-e269-4830-aa3c-3ef3a8a013e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:38.998551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440b92a-e269-4830-aa3c-3ef3a8a013e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:39.000646 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440b92a-e269-4830-aa3c-3ef3a8a013e7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:39.032731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7c5d8-9d3d-43ea-ae93-071b71190d08 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:39.070677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95c37-0ec9-4f29-8302-16bca76cdcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:39.072120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95c37-0ec9-4f29-8302-16bca76cdcb3 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.072744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95c37-0ec9-4f29-8302-16bca76cdcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.073319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95c37-0ec9-4f29-8302-16bca76cdcb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.074325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95c37-0ec9-4f29-8302-16bca76cdcb3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:39.075976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95c37-0ec9-4f29-8302-16bca76cdcb3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:39.140825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 20/36] 10.222.0.58 () {60 vars in 1131 bytes} [Mon May 16 17:25:38 2022] POST /identity/v3/roles => generated 225 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:25:39.141816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b92a-e269-4830-aa3c-3ef3a8a013e7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:39.202740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 17/37] 10.222.0.58 () {60 vars in 1131 bytes} [Mon May 16 17:25:38 2022] POST /identity/v3/roles => generated 219 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:25:39.204101 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95c37-0ec9-4f29-8302-16bca76cdcb3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:39.321810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95c37-0ec9-4f29-8302-16bca76cdcb3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:39.326701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b92a-e269-4830-aa3c-3ef3a8a013e7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:39.369037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768988d9-03c3-41ec-b576-a19493a19eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:39.369037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768988d9-03c3-41ec-b576-a19493a19eab None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.369037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768988d9-03c3-41ec-b576-a19493a19eab None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.369037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768988d9-03c3-41ec-b576-a19493a19eab None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.369436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768988d9-03c3-41ec-b576-a19493a19eab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:39.369436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768988d9-03c3-41ec-b576-a19493a19eab None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:39.379035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991a3d4-302a-4ab0-8416-ab53ec35ca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:39.379946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a3d4-302a-4ab0-8416-ab53ec35ca18 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.380225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a3d4-302a-4ab0-8416-ab53ec35ca18 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.380504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a3d4-302a-4ab0-8416-ab53ec35ca18 None admin] PATH_INFO: `/v3/domains/default/users/4463e4c93e664f46a81171f07eadb93c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.388996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991a3d4-302a-4ab0-8416-ab53ec35ca18 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4463e4c93e664f46a81171f07eadb93c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:39.391977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991a3d4-302a-4ab0-8416-ab53ec35ca18 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:39.437639 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 18/38] 10.222.0.58 () {58 vars in 1361 bytes} [Mon May 16 17:25:39 2022] PUT /identity/v3/domains/default/users/4463e4c93e664f46a81171f07eadb93c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:25:39.445123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 21/39] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:25:39 2022] POST /identity/v3/projects => generated 301 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:25:39.676287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f674e-b1c5-40b6-bc92-d7423b0d0f9b None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.676621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f674e-b1c5-40b6-bc92-d7423b0d0f9b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.676850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f674e-b1c5-40b6-bc92-d7423b0d0f9b None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.678630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 19/40] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:39.685233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6efbb-a675-4118-8815-5ee306af7504 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.685543 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6efbb-a675-4118-8815-5ee306af7504 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.685828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6efbb-a675-4118-8815-5ee306af7504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.705789 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8ee6efbb-a675-4118-8815-5ee306af7504 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:39.707323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8ee6efbb-a675-4118-8815-5ee306af7504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:39.726001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5866-1d28-4e04-a537-b33dae5443fa None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.726618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5866-1d28-4e04-a537-b33dae5443fa None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.727083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5866-1d28-4e04-a537-b33dae5443fa None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.728644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 20/41] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:25:39.735238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010bfab-ab6f-4bf1-91d4-eb1ad49e3402 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.735528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010bfab-ab6f-4bf1-91d4-eb1ad49e3402 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.735809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010bfab-ab6f-4bf1-91d4-eb1ad49e3402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.756442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3010bfab-ab6f-4bf1-91d4-eb1ad49e3402 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:39.758004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3010bfab-ab6f-4bf1-91d4-eb1ad49e3402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:39.783797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 22/42] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:39.806790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6efbb-a675-4118-8815-5ee306af7504 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:39.828645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 21/43] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:25:39.851724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010bfab-ab6f-4bf1-91d4-eb1ad49e3402 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:39.902484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6efbb-a675-4118-8815-5ee306af7504 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:39.938086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0af28-1578-4d82-a61b-16883f1c3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:39.938689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0af28-1578-4d82-a61b-16883f1c3266 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.938965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0af28-1578-4d82-a61b-16883f1c3266 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.939233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0af28-1578-4d82-a61b-16883f1c3266 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.939970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0af28-1578-4d82-a61b-16883f1c3266 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:39.941359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0af28-1578-4d82-a61b-16883f1c3266 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:39.954168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010bfab-ab6f-4bf1-91d4-eb1ad49e3402 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:39.958127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1131 bytes} [Mon May 16 17:25:39 2022] POST /identity/v3/roles => generated 223 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:25:39.989633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feb727-d7e7-41c5-8857-c557e2dd94b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:39.990458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb727-d7e7-41c5-8857-c557e2dd94b5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:39.990739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb727-d7e7-41c5-8857-c557e2dd94b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:39.991013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb727-d7e7-41c5-8857-c557e2dd94b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:39.992231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35feb727-d7e7-41c5-8857-c557e2dd94b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:39.993815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35feb727-d7e7-41c5-8857-c557e2dd94b5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:39.995540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 22/45] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:40.001532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0af28-1578-4d82-a61b-16883f1c3266 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:40.111444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0af28-1578-4d82-a61b-16883f1c3266 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:40.153614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45539f02-f8cd-46e2-b8bc-6cde7771d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:40.153614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539f02-f8cd-46e2-b8bc-6cde7771d618 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:40.153614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539f02-f8cd-46e2-b8bc-6cde7771d618 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:40.153614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539f02-f8cd-46e2-b8bc-6cde7771d618 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:40.154033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45539f02-f8cd-46e2-b8bc-6cde7771d618 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:40.155288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45539f02-f8cd-46e2-b8bc-6cde7771d618 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:40.185089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:25:40 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:25:41.740708 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c99c7-311b-4714-8575-f5be87d6ddb5 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:41.741252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c99c7-311b-4714-8575-f5be87d6ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:41.741252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c99c7-311b-4714-8575-f5be87d6ddb5 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:41.742655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 23/47] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:41.748015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e020-31d4-4cac-a598-641c33243a59 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:41.748397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e020-31d4-4cac-a598-641c33243a59 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:41.748571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e020-31d4-4cac-a598-641c33243a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:41.766143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e0c2e020-31d4-4cac-a598-641c33243a59 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:41.767304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e0c2e020-31d4-4cac-a598-641c33243a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:41.834428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 25/48] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:41.856722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c99c7-311b-4714-8575-f5be87d6ddb5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:41.958801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c99c7-311b-4714-8575-f5be87d6ddb5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:41.993893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedb202-c041-4fa6-9651-f094c34f9997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:41.994595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedb202-c041-4fa6-9651-f094c34f9997 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:41.994876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedb202-c041-4fa6-9651-f094c34f9997 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:41.995584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedb202-c041-4fa6-9651-f094c34f9997 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.006644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedb202-c041-4fa6-9651-f094c34f9997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-5eedb202-c041-4fa6-9651-f094c34f9997 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:42.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:42.016326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:42.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 24/49] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:42.024056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2e020-31d4-4cac-a598-641c33243a59 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:42.125738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2e020-31d4-4cac-a598-641c33243a59 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:42.159333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:42.160006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:42.160287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:42.160548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.161300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:42.161630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:42.163016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:42.171183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 26/50] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:42.176812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedb202-c041-4fa6-9651-f094c34f9997 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:42.280011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedb202-c041-4fa6-9651-f094c34f9997 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:42.313607 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4468f3c-4a24-4280-83e7-7615bf89bd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:42.314519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468f3c-4a24-4280-83e7-7615bf89bd40 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:42.314798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468f3c-4a24-4280-83e7-7615bf89bd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:42.315069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468f3c-4a24-4280-83e7-7615bf89bd40 None admin] PATH_INFO: `/v3/users/4463e4c93e664f46a81171f07eadb93c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.316273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4468f3c-4a24-4280-83e7-7615bf89bd40 None admin] RBAC: Authorizing `identity:get_user(user_id=4463e4c93e664f46a81171f07eadb93c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:42.319236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4468f3c-4a24-4280-83e7-7615bf89bd40 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:42.319507 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 25/51] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:42 2022] GET /identity/v3/users/4463e4c93e664f46a81171f07eadb93c => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:42.326048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:42.397963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5845ce-11e2-49ca-b311-53988fc17f0c None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:42.398197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5845ce-11e2-49ca-b311-53988fc17f0c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:42.398504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5845ce-11e2-49ca-b311-53988fc17f0c None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.400034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 26/52] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:25:42.404821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1aa94-f91d-42cb-8a97-b71fb335e402 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:42.405108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1aa94-f91d-42cb-8a97-b71fb335e402 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:42.405393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1aa94-f91d-42cb-8a97-b71fb335e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.422494 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-afc1aa94-f91d-42cb-8a97-b71fb335e402 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:42.423697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-afc1aa94-f91d-42cb-8a97-b71fb335e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:42.427277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27be055-a4c4-4ae6-a3d0-3036512b6413 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:42.458891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b197e-31f7-4f75-9eb1-12ba2aecd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:42.459707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b197e-31f7-4f75-9eb1-12ba2aecd865 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:42.459991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b197e-31f7-4f75-9eb1-12ba2aecd865 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:42.460263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b197e-31f7-4f75-9eb1-12ba2aecd865 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.461427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b197e-31f7-4f75-9eb1-12ba2aecd865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:42.462894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b197e-31f7-4f75-9eb1-12ba2aecd865 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:42.464497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:42.470509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b197e-31f7-4f75-9eb1-12ba2aecd865 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:42.487817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 27/54] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:25:42.510954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1aa94-f91d-42cb-8a97-b71fb335e402 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:42.571299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b197e-31f7-4f75-9eb1-12ba2aecd865 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:42.605032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:42.605759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:42.606044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:42.606328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.607159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.domain.id=default, user.id=4463e4c93e664f46a81171f07eadb93c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:42.607471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:42.608975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:42.610293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1aa94-f91d-42cb-8a97-b71fb335e402 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:42.614899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1322 bytes} [Mon May 16 17:25:42 2022] GET /identity/v3/role_assignments?user.id=4463e4c93e664f46a81171f07eadb93c&scope.domain.id=default&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:42.645709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0fb0d-9936-4c1d-aa32-03091a2f7e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:42.646547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0fb0d-9936-4c1d-aa32-03091a2f7e6a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:42.646806 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0fb0d-9936-4c1d-aa32-03091a2f7e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:42.647078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0fb0d-9936-4c1d-aa32-03091a2f7e6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.648388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0fb0d-9936-4c1d-aa32-03091a2f7e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:42.649917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0fb0d-9936-4c1d-aa32-03091a2f7e6a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:42.651819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 28/56] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:42.657819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:42.764141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2a7f7-5a7e-4452-b702-d699b135000b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:42.799809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f94af-13d4-4ae2-8f6a-90697a2f1226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:42.800476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f94af-13d4-4ae2-8f6a-90697a2f1226 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:42.801234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f94af-13d4-4ae2-8f6a-90697a2f1226 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:42.801234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f94af-13d4-4ae2-8f6a-90697a2f1226 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:42.801727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f94af-13d4-4ae2-8f6a-90697a2f1226 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:42.803513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f94af-13d4-4ae2-8f6a-90697a2f1226 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:42.831041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 29/57] 10.222.0.58 () {60 vars in 1140 bytes} [Mon May 16 17:25:42 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:25:45.071294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424257-7ede-4f47-8209-5b948e584c14 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:45.072165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424257-7ede-4f47-8209-5b948e584c14 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:45.072165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424257-7ede-4f47-8209-5b948e584c14 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:45.074362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 29/58] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:45.083024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eeb0b-d1c1-4ed9-a006-0ebf09e1045f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:45.083448 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eeb0b-d1c1-4ed9-a006-0ebf09e1045f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:45.083638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eeb0b-d1c1-4ed9-a006-0ebf09e1045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:45.104359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-389eeb0b-d1c1-4ed9-a006-0ebf09e1045f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:45.105543 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-389eeb0b-d1c1-4ed9-a006-0ebf09e1045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:45.175319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 30/59] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:45.204342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424257-7ede-4f47-8209-5b948e584c14 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:45.315875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424257-7ede-4f47-8209-5b948e584c14 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:45.350594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a104f-e377-4d37-8ab6-1c2d4197ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:45.351327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a104f-e377-4d37-8ab6-1c2d4197ce2d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:45.351611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a104f-e377-4d37-8ab6-1c2d4197ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:45.351891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a104f-e377-4d37-8ab6-1c2d4197ce2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:45.353183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a104f-e377-4d37-8ab6-1c2d4197ce2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:45.354685 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a104f-e377-4d37-8ab6-1c2d4197ce2d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:45.356289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 30/60] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:45.362276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389eeb0b-d1c1-4ed9-a006-0ebf09e1045f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:45.480710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389eeb0b-d1c1-4ed9-a006-0ebf09e1045f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:45.517191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2355547-1861-4e33-82fc-9ab3bdc0d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:45.517893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355547-1861-4e33-82fc-9ab3bdc0d002 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:45.518176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355547-1861-4e33-82fc-9ab3bdc0d002 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:45.518451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355547-1861-4e33-82fc-9ab3bdc0d002 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:45.519168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2355547-1861-4e33-82fc-9ab3bdc0d002 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:45.520628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2355547-1861-4e33-82fc-9ab3bdc0d002 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:45.554563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 31/61] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:25:45 2022] POST /identity/v3/users => generated 275 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:25:48.822733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814b16-e779-423f-abdc-07dd0a10096d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:48.823251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814b16-e779-423f-abdc-07dd0a10096d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:48.823358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814b16-e779-423f-abdc-07dd0a10096d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:48.824931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 31/62] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:48.834032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1bb3f-281f-4232-af74-ce75a4d82a3d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:48.834530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1bb3f-281f-4232-af74-ce75a4d82a3d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:48.834599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1bb3f-281f-4232-af74-ce75a4d82a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:48.862553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-01d1bb3f-281f-4232-af74-ce75a4d82a3d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:48.863754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-01d1bb3f-281f-4232-af74-ce75a4d82a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:48.946240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 32/63] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:48.984127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80814b16-e779-423f-abdc-07dd0a10096d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:49.109019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80814b16-e779-423f-abdc-07dd0a10096d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:49.151017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15996d3-2c0f-463a-8eb5-fc85194c7e3a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.151639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15996d3-2c0f-463a-8eb5-fc85194c7e3a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.152216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15996d3-2c0f-463a-8eb5-fc85194c7e3a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.152546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3f200-b5b4-4c27-ad22-716280f00ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:49.153356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3f200-b5b4-4c27-ad22-716280f00ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.153680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3f200-b5b4-4c27-ad22-716280f00ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.153959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3f200-b5b4-4c27-ad22-716280f00ee0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.154744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 33/64] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:49.164216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a702-ded5-4b69-b98d-f0a0ef418b94 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.164772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a702-ded5-4b69-b98d-f0a0ef418b94 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.165294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a702-ded5-4b69-b98d-f0a0ef418b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.178269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3f200-b5b4-4c27-ad22-716280f00ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-97d3f200-b5b4-4c27-ad22-716280f00ee0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:49.186324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:49.187564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:49.189049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:49.198620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 32/65] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:49.199849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ef6a702-ded5-4b69-b98d-f0a0ef418b94 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:49.201232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ef6a702-ded5-4b69-b98d-f0a0ef418b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:49.204689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3f200-b5b4-4c27-ad22-716280f00ee0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:49.285289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 34/66] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:25:49.287027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0bfe9-c0aa-43c5-b59b-7ddff274f292 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.287538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0bfe9-c0aa-43c5-b59b-7ddff274f292 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.288007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0bfe9-c0aa-43c5-b59b-7ddff274f292 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.289722 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 35/67] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:49.299513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb7e4-21ac-4949-bbb3-dd8fa18ea43b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.300309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb7e4-21ac-4949-bbb3-dd8fa18ea43b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.300797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb7e4-21ac-4949-bbb3-dd8fa18ea43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.325010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a7feb7e4-21ac-4949-bbb3-dd8fa18ea43b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:49.326630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a7feb7e4-21ac-4949-bbb3-dd8fa18ea43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:49.329328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3f200-b5b4-4c27-ad22-716280f00ee0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:49.370897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:49.371755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.372042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.372326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.373082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:49.373390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:49.375351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:49.386345 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 33/68] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:25:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:49.387543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:49.402186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 36/69] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:49.403850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb7e4-21ac-4949-bbb3-dd8fa18ea43b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:49.489017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29d816-c08b-4d13-b235-6df0110da865 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:49.528026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f27be-afdb-4c82-baa9-7916243cff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:49.528783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f27be-afdb-4c82-baa9-7916243cff99 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.529066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f27be-afdb-4c82-baa9-7916243cff99 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.529338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f27be-afdb-4c82-baa9-7916243cff99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.530538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb7e4-21ac-4949-bbb3-dd8fa18ea43b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:49.539951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f27be-afdb-4c82-baa9-7916243cff99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-7a1f27be-afdb-4c82-baa9-7916243cff99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:49.548027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:49.548850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:49.549665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 34/70] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:25:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:49.550872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f27be-afdb-4c82-baa9-7916243cff99 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:49.572274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc0bfa-2574-436a-9a73-38c5b71e8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:49.573163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc0bfa-2574-436a-9a73-38c5b71e8f91 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.573437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc0bfa-2574-436a-9a73-38c5b71e8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.573751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc0bfa-2574-436a-9a73-38c5b71e8f91 None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.586845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc0bfa-2574-436a-9a73-38c5b71e8f91 None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:49.588311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc0bfa-2574-436a-9a73-38c5b71e8f91 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:49.590199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 37/71] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:49 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:49.594996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a65bf-6ae4-40de-811b-01a707d719c4 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.595286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a65bf-6ae4-40de-811b-01a707d719c4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.595569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a65bf-6ae4-40de-811b-01a707d719c4 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.596872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 38/72] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:49.597972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a65bf-6ae4-40de-811b-01a707d719c4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:49.659252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f27be-afdb-4c82-baa9-7916243cff99 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:49.692113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5d17-0429-4545-955b-a93230aabb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:49.692908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5d17-0429-4545-955b-a93230aabb7e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.693190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5d17-0429-4545-955b-a93230aabb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.693464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5d17-0429-4545-955b-a93230aabb7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.699104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a65bf-6ae4-40de-811b-01a707d719c4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:49.703330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a5d17-0429-4545-955b-a93230aabb7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-383a5d17-0429-4545-955b-a93230aabb7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:49.710857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:49.711747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:49.712509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 35/73] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:49.713773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5d17-0429-4545-955b-a93230aabb7e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:49.734424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0278ce-96a5-49c2-b6e0-2029bede89f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:49.735098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0278ce-96a5-49c2-b6e0-2029bede89f6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.735370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0278ce-96a5-49c2-b6e0-2029bede89f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.735636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0278ce-96a5-49c2-b6e0-2029bede89f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.736381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0278ce-96a5-49c2-b6e0-2029bede89f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:49.736683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0278ce-96a5-49c2-b6e0-2029bede89f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:49.738098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0278ce-96a5-49c2-b6e0-2029bede89f6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:49.746102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 39/74] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:25:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:49.747265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea70c9-8684-408e-aa49-ffe317d7785b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.747550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea70c9-8684-408e-aa49-ffe317d7785b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.747825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea70c9-8684-408e-aa49-ffe317d7785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.764779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9cea70c9-8684-408e-aa49-ffe317d7785b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:49.766059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9cea70c9-8684-408e-aa49-ffe317d7785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:49.808963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5d17-0429-4545-955b-a93230aabb7e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:49.827985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 40/75] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:49.829293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0d99-c313-4388-acfe-eb9b1b00e0e1 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.829572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0d99-c313-4388-acfe-eb9b1b00e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.829879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a0d99-c313-4388-acfe-eb9b1b00e0e1 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.831330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 41/76] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:49.831849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a0d99-c313-4388-acfe-eb9b1b00e0e1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:49.846198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa533e-66ed-4ace-bee9-58651b1efd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:49.846888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa533e-66ed-4ace-bee9-58651b1efd94 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.847146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa533e-66ed-4ace-bee9-58651b1efd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.847422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa533e-66ed-4ace-bee9-58651b1efd94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.913325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa533e-66ed-4ace-bee9-58651b1efd94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:49.914764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa533e-66ed-4ace-bee9-58651b1efd94 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:49.930308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a0d99-c313-4388-acfe-eb9b1b00e0e1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:49.972599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:49.973266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:49.973523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:49.973838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:49.974581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:49.974886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:49.976289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:49.984314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 42/77] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:49.988921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.015528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 36/78] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:25:50.016809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42011fa-b0e9-405d-ab66-b7a8f15273f9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.017100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42011fa-b0e9-405d-ab66-b7a8f15273f9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.017373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42011fa-b0e9-405d-ab66-b7a8f15273f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.033601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a42011fa-b0e9-405d-ab66-b7a8f15273f9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:50.034786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a42011fa-b0e9-405d-ab66-b7a8f15273f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:50.087664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a6d2-8cb2-4fb6-bc19-d37b5d447e7f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.097416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 37/79] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:50.098299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42011fa-b0e9-405d-ab66-b7a8f15273f9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.120475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadab8a-f467-410c-b533-ed35275ebfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.121355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadab8a-f467-410c-b533-ed35275ebfbe None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.121676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadab8a-f467-410c-b533-ed35275ebfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.121957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadab8a-f467-410c-b533-ed35275ebfbe None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.123172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadab8a-f467-410c-b533-ed35275ebfbe None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.124655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadab8a-f467-410c-b533-ed35275ebfbe None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.130654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 43/80] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:49 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:50.130654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadab8a-f467-410c-b533-ed35275ebfbe None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.192480 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42011fa-b0e9-405d-ab66-b7a8f15273f9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.221132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadab8a-f467-410c-b533-ed35275ebfbe None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.226485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb3518-3d06-4c2b-8ba0-582f83dd194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.227276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3518-3d06-4c2b-8ba0-582f83dd194a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.227553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3518-3d06-4c2b-8ba0-582f83dd194a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.227824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3518-3d06-4c2b-8ba0-582f83dd194a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.237886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb3518-3d06-4c2b-8ba0-582f83dd194a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d8bb3518-3d06-4c2b-8ba0-582f83dd194a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:50.245381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:50.246391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:50.247213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 38/81] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:50.247844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb3518-3d06-4c2b-8ba0-582f83dd194a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.255820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25d404-7b1c-4e72-8904-ceeff9a39f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.256694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d404-7b1c-4e72-8904-ceeff9a39f68 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.256956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d404-7b1c-4e72-8904-ceeff9a39f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.257228 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d404-7b1c-4e72-8904-ceeff9a39f68 None admin] PATH_INFO: `/v3/users/4463e4c93e664f46a81171f07eadb93c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.258431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25d404-7b1c-4e72-8904-ceeff9a39f68 None admin] RBAC: Authorizing `identity:get_user(user_id=4463e4c93e664f46a81171f07eadb93c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.259896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25d404-7b1c-4e72-8904-ceeff9a39f68 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.261518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 44/82] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/users/4463e4c93e664f46a81171f07eadb93c => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:50.262285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25d404-7b1c-4e72-8904-ceeff9a39f68 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.348676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb3518-3d06-4c2b-8ba0-582f83dd194a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.365177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25d404-7b1c-4e72-8904-ceeff9a39f68 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.384515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0a73b-fc59-4a46-9df3-d2b4c9c11bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.384515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a73b-fc59-4a46-9df3-d2b4c9c11bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.384515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a73b-fc59-4a46-9df3-d2b4c9c11bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.384515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a73b-fc59-4a46-9df3-d2b4c9c11bb5 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.386408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0a73b-fc59-4a46-9df3-d2b4c9c11bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.387880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0a73b-fc59-4a46-9df3-d2b4c9c11bb5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.389837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 39/83] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:50.390373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0a73b-fc59-4a46-9df3-d2b4c9c11bb5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.403532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fdd31-bee3-4992-a339-a34e31daafdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.404340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fdd31-bee3-4992-a339-a34e31daafdf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.404616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fdd31-bee3-4992-a339-a34e31daafdf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.404896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fdd31-bee3-4992-a339-a34e31daafdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.406226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fdd31-bee3-4992-a339-a34e31daafdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.407684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fdd31-bee3-4992-a339-a34e31daafdf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.409450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 45/84] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:50.413153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fdd31-bee3-4992-a339-a34e31daafdf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.481141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0a73b-fc59-4a46-9df3-d2b4c9c11bb5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.511112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fdd31-bee3-4992-a339-a34e31daafdf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.512021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e716-04d9-4056-a038-64cecea1dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.512704 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e716-04d9-4056-a038-64cecea1dc0c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.512987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e716-04d9-4056-a038-64cecea1dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.513260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e716-04d9-4056-a038-64cecea1dc0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.543236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.543900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.544185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.544463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.545205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:50.545510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.546920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.555291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 46/85] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:50.556804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.580422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e716-04d9-4056-a038-64cecea1dc0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.581909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e716-04d9-4056-a038-64cecea1dc0c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.654332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571286f-9fc8-4173-ad57-d7c814d113b6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.678170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 40/86] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:25:50.678801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e716-04d9-4056-a038-64cecea1dc0c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.690992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e6911-095f-452b-b8c8-1083a36178d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.691653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6911-095f-452b-b8c8-1083a36178d2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.691938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6911-095f-452b-b8c8-1083a36178d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.692219 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6911-095f-452b-b8c8-1083a36178d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.757923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e6911-095f-452b-b8c8-1083a36178d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.759371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e6911-095f-452b-b8c8-1083a36178d2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.769522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e716-04d9-4056-a038-64cecea1dc0c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.802700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.803352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.803633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.803910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.804736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] RBAC: Adding query filter params (role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=0463b87212e547209f1edc8f93d9401a, user.id=8462e07973b6479ab690bab71d456f27) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:50.805046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.806530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.814187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 41/87] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/role_assignments?user.id=8462e07973b6479ab690bab71d456f27&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=c9deaccdca814832a7d143419fd1d54f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:50.814936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.862858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 47/88] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:25:50.862858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e6911-095f-452b-b8c8-1083a36178d2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:50.918887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f74228-77e0-496f-a26d-148aed6ec02f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.952667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132ec6-2812-4567-b724-d63211e8454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:50.953700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132ec6-2812-4567-b724-d63211e8454e None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:50.953989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132ec6-2812-4567-b724-d63211e8454e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:50.954273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132ec6-2812-4567-b724-d63211e8454e None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:50.955008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d132ec6-2812-4567-b724-d63211e8454e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:50.956508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d132ec6-2812-4567-b724-d63211e8454e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:50.963980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e6911-095f-452b-b8c8-1083a36178d2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:50.983948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 42/89] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:25:50 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:25:50.996888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132ec6-2812-4567-b724-d63211e8454e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:51.003037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de8e04-b3f1-4334-8336-868ae6c25934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:51.003951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de8e04-b3f1-4334-8336-868ae6c25934 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:51.004232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de8e04-b3f1-4334-8336-868ae6c25934 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:51.004503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de8e04-b3f1-4334-8336-868ae6c25934 None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:51.005859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de8e04-b3f1-4334-8336-868ae6c25934 None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:51.007362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de8e04-b3f1-4334-8336-868ae6c25934 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:51.009311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 48/90] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:51.010141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de8e04-b3f1-4334-8336-868ae6c25934 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:51.103291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132ec6-2812-4567-b724-d63211e8454e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:51.124651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de8e04-b3f1-4334-8336-868ae6c25934 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:51.140407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29323b33-3b68-470d-9de0-6284d8dc399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:51.146987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29323b33-3b68-470d-9de0-6284d8dc399b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:51.147648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29323b33-3b68-470d-9de0-6284d8dc399b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:51.148127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29323b33-3b68-470d-9de0-6284d8dc399b None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:51.149907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29323b33-3b68-470d-9de0-6284d8dc399b None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:51.151618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29323b33-3b68-470d-9de0-6284d8dc399b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:51.153675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 43/91] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:50 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:51.154691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29323b33-3b68-470d-9de0-6284d8dc399b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:51.169018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b7f3-f24a-4d72-94bb-898092d167d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:51.170041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b7f3-f24a-4d72-94bb-898092d167d2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:51.170672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b7f3-f24a-4d72-94bb-898092d167d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:51.170672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b7f3-f24a-4d72-94bb-898092d167d2 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:51.171992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8b7f3-f24a-4d72-94bb-898092d167d2 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:51.173721 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8b7f3-f24a-4d72-94bb-898092d167d2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:51.175579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 49/92] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:51 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:51.176599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b7f3-f24a-4d72-94bb-898092d167d2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:51.283971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29323b33-3b68-470d-9de0-6284d8dc399b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:51.309280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b7f3-f24a-4d72-94bb-898092d167d2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:51.336090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a32f1-b391-44ec-9211-dd3aa76edd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:51.336753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a32f1-b391-44ec-9211-dd3aa76edd0a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:51.337036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a32f1-b391-44ec-9211-dd3aa76edd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:51.337320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a32f1-b391-44ec-9211-dd3aa76edd0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:51.350322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:51.351230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:51.351516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:51.351797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:51.352643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] RBAC: Adding query filter params (role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=0463b87212e547209f1edc8f93d9401a, user.id=8462e07973b6479ab690bab71d456f27) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:51.352974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:51.356092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:51.364428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 50/93] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:25:51 2022] GET /identity/v3/role_assignments?user.id=8462e07973b6479ab690bab71d456f27&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:51.365812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:51.424717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a32f1-b391-44ec-9211-dd3aa76edd0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:51.426264 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a32f1-b391-44ec-9211-dd3aa76edd0a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:51.482769 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c73b-f625-48cb-af81-ddd03f8bd31e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:51.517728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:51.518752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:51.519231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:51.519692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:51.520761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=0463b87212e547209f1edc8f93d9401a, user.id=4463e4c93e664f46a81171f07eadb93c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:51.521282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:51.523042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:51.528316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 44/94] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:25:51.529932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 51/95] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:25:51 2022] GET /identity/v3/role_assignments?user.id=4463e4c93e664f46a81171f07eadb93c&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:51.534156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a32f1-b391-44ec-9211-dd3aa76edd0a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:51.647018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a32f1-b391-44ec-9211-dd3aa76edd0a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:51.694447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34a65-21c0-43ee-ac2c-2af04c54304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:51.695716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34a65-21c0-43ee-ac2c-2af04c54304c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:51.696219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34a65-21c0-43ee-ac2c-2af04c54304c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:51.696703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34a65-21c0-43ee-ac2c-2af04c54304c None admin] PATH_INFO: `/v3/projects/bcff62d19b4c49a1a1ee02a2773f7a8f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:51.698328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34a65-21c0-43ee-ac2c-2af04c54304c None admin] RBAC: Authorizing `identity:get_project(project_id=bcff62d19b4c49a1a1ee02a2773f7a8f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:51.700035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34a65-21c0-43ee-ac2c-2af04c54304c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:51.702084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 45/96] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:51 2022] GET /identity/v3/projects/bcff62d19b4c49a1a1ee02a2773f7a8f => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:51.708169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:51.835971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac77a94-1bf2-44b6-bea8-58d81850b781 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:51.874947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa9016-528c-41fe-b299-9bb9c69c1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:51.876000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9016-528c-41fe-b299-9bb9c69c1b76 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:51.876474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9016-528c-41fe-b299-9bb9c69c1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:51.876967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9016-528c-41fe-b299-9bb9c69c1b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:51.878029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa9016-528c-41fe-b299-9bb9c69c1b76 None admin] RBAC: Adding query filter params (role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=bcff62d19b4c49a1a1ee02a2773f7a8f, user.id=8462e07973b6479ab690bab71d456f27) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:51.878535 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa9016-528c-41fe-b299-9bb9c69c1b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:51.880184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa9016-528c-41fe-b299-9bb9c69c1b76 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:51.890791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 52/97] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:25:51 2022] GET /identity/v3/role_assignments?user.id=8462e07973b6479ab690bab71d456f27&scope.project.id=bcff62d19b4c49a1a1ee02a2773f7a8f&role.id=c9deaccdca814832a7d143419fd1d54f => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:53.756984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a33f-8321-43a9-af1d-54c9b8ec2a4a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:53.758019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a33f-8321-43a9-af1d-54c9b8ec2a4a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:53.758498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a33f-8321-43a9-af1d-54c9b8ec2a4a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:53.760096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 46/98] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:53.766042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eac23-3932-4c57-97ad-154813376e0a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:53.766875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eac23-3932-4c57-97ad-154813376e0a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:53.767346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eac23-3932-4c57-97ad-154813376e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:53.784424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ff0eac23-3932-4c57-97ad-154813376e0a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:53.785916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ff0eac23-3932-4c57-97ad-154813376e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:53.853464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 53/99] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:53.880186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87a33f-8321-43a9-af1d-54c9b8ec2a4a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:53.979976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87a33f-8321-43a9-af1d-54c9b8ec2a4a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:54.013917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549909-c531-4053-aa64-1317de8ee6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:54.015114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549909-c531-4053-aa64-1317de8ee6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549909-c531-4053-aa64-1317de8ee6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.016051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549909-c531-4053-aa64-1317de8ee6b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.026653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c549909-c531-4053-aa64-1317de8ee6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1c549909-c531-4053-aa64-1317de8ee6b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:54.034700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:54.035570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:54.036320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:54.038680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 47/100] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:25:54.044907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0eac23-3932-4c57-97ad-154813376e0a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:54.147507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0eac23-3932-4c57-97ad-154813376e0a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:54.183172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:54.184251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.184724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.185186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.186165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:54.186720 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:54.188294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:54.201650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 54/101] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:25:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:54.204340 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549909-c531-4053-aa64-1317de8ee6b8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:54.305218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549909-c531-4053-aa64-1317de8ee6b8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:54.338199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5d29d-939f-4c07-a5e9-4d7c4d243958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:54.339088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d29d-939f-4c07-a5e9-4d7c4d243958 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.339369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d29d-939f-4c07-a5e9-4d7c4d243958 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.339643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d29d-939f-4c07-a5e9-4d7c4d243958 None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.340846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5d29d-939f-4c07-a5e9-4d7c4d243958 None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:54.342343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5d29d-939f-4c07-a5e9-4d7c4d243958 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:54.344055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 48/102] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:54 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:54.349735 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:54.455799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dcc54-609f-4b12-a609-dfba9750143f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:54.485602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272442-0d04-44f3-a041-c6ea772ed1b7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.486107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272442-0d04-44f3-a041-c6ea772ed1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.486553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272442-0d04-44f3-a041-c6ea772ed1b7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.489991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30629d5f-6c47-49ac-8093-8d2e0718f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:54.491101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629d5f-6c47-49ac-8093-8d2e0718f09c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.491587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629d5f-6c47-49ac-8093-8d2e0718f09c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.492062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629d5f-6c47-49ac-8093-8d2e0718f09c None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.493456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30629d5f-6c47-49ac-8093-8d2e0718f09c None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:54.495144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30629d5f-6c47-49ac-8093-8d2e0718f09c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:54.497040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 55/104] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:54 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:54.497262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 49/104] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:54.502150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c98f-6fde-4e1e-b275-ae41dcd59647 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.502426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c98f-6fde-4e1e-b275-ae41dcd59647 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.502896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c98f-6fde-4e1e-b275-ae41dcd59647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.508687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30629d5f-6c47-49ac-8093-8d2e0718f09c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:54.546846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f740c98f-6fde-4e1e-b275-ae41dcd59647 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:54.548589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f740c98f-6fde-4e1e-b275-ae41dcd59647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:54.623565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30629d5f-6c47-49ac-8093-8d2e0718f09c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:54.659965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a41d0-059e-43c0-abe0-5508082088d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:54.661531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a41d0-059e-43c0-abe0-5508082088d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.661979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a41d0-059e-43c0-abe0-5508082088d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.662564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a41d0-059e-43c0-abe0-5508082088d8 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a/users/8462e07973b6479ab690bab71d456f27/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.664879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a41d0-059e-43c0-abe0-5508082088d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0463b87212e547209f1edc8f93d9401a, user_id=8462e07973b6479ab690bab71d456f27, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:54.666802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a41d0-059e-43c0-abe0-5508082088d8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:54.696834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 56/105] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:25:54 2022] PUT /identity/v3/projects/0463b87212e547209f1edc8f93d9401a/users/8462e07973b6479ab690bab71d456f27/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:25:54.701999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba60651-945c-4b90-ada4-e480f07c93b3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.703000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba60651-945c-4b90-ada4-e480f07c93b3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.703500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba60651-945c-4b90-ada4-e480f07c93b3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.703911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 50/106] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:25:54.710031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 57/107] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:54.717744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7a4b-76b9-4ea7-aa53-645638027ddd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:54.718211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7a4b-76b9-4ea7-aa53-645638027ddd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:54.718597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7a4b-76b9-4ea7-aa53-645638027ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:54.750978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-596f7a4b-76b9-4ea7-aa53-645638027ddd None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:54.752205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-596f7a4b-76b9-4ea7-aa53-645638027ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:54.786144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba60651-945c-4b90-ada4-e480f07c93b3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:54.837374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 51/108] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:54.898086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f7a4b-76b9-4ea7-aa53-645638027ddd None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:54.995309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba60651-945c-4b90-ada4-e480f07c93b3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.063663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae370b-a24e-4e4d-b985-47345c35e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.064929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae370b-a24e-4e4d-b985-47345c35e702 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.065440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae370b-a24e-4e4d-b985-47345c35e702 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.065934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae370b-a24e-4e4d-b985-47345c35e702 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.077767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae370b-a24e-4e4d-b985-47345c35e702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8eae370b-a24e-4e4d-b985-47345c35e702 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:55.085977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:55.086862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:25:55.087662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:25:55.090104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 58/109] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:25:55.091702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d379-5896-45e4-86e6-c469fd64eb6f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.092239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d379-5896-45e4-86e6-c469fd64eb6f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.092868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d379-5896-45e4-86e6-c469fd64eb6f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.095338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 59/110] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:55.097407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d379-5896-45e4-86e6-c469fd64eb6f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:55.108339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f7a4b-76b9-4ea7-aa53-645638027ddd None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.179677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daaf5d-8a88-44ee-b6e6-a2335a12e3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.181612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daaf5d-8a88-44ee-b6e6-a2335a12e3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.182062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daaf5d-8a88-44ee-b6e6-a2335a12e3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.182477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daaf5d-8a88-44ee-b6e6-a2335a12e3b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.203333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daaf5d-8a88-44ee-b6e6-a2335a12e3b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-89daaf5d-8a88-44ee-b6e6-a2335a12e3b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:55.216646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:55.218219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:25:55.218974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:55.222355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 52/111] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:25:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:55.225000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6249-8192-4d57-aff2-3ebd2a4fde5e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.225288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6249-8192-4d57-aff2-3ebd2a4fde5e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.225582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6249-8192-4d57-aff2-3ebd2a4fde5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.261904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f1ba6249-8192-4d57-aff2-3ebd2a4fde5e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:55.263112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f1ba6249-8192-4d57-aff2-3ebd2a4fde5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:55.291786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d379-5896-45e4-86e6-c469fd64eb6f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.343645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c6242-a76a-4a52-a5ac-8b6540211090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.344603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6242-a76a-4a52-a5ac-8b6540211090 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.345001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6242-a76a-4a52-a5ac-8b6540211090 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.345397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6242-a76a-4a52-a5ac-8b6540211090 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.346600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c6242-a76a-4a52-a5ac-8b6540211090 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:55.347074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c6242-a76a-4a52-a5ac-8b6540211090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:55.349682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c6242-a76a-4a52-a5ac-8b6540211090 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:55.350656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 53/112] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:55.351615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba6249-8192-4d57-aff2-3ebd2a4fde5e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:55.363645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 60/113] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:25:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:55.365637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f83a97-2de1-4402-ba05-3d69a5971bc9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.366043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f83a97-2de1-4402-ba05-3d69a5971bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.366425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f83a97-2de1-4402-ba05-3d69a5971bc9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.368368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 61/114] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:55.369348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f83a97-2de1-4402-ba05-3d69a5971bc9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:55.472636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba6249-8192-4d57-aff2-3ebd2a4fde5e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.500711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f83a97-2de1-4402-ba05-3d69a5971bc9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.514057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ffc7c-b13b-4f2e-a50c-b46e7575c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.514811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ffc7c-b13b-4f2e-a50c-b46e7575c396 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.515096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ffc7c-b13b-4f2e-a50c-b46e7575c396 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.515376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ffc7c-b13b-4f2e-a50c-b46e7575c396 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.516513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ffc7c-b13b-4f2e-a50c-b46e7575c396 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:55.516825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ffc7c-b13b-4f2e-a50c-b46e7575c396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:55.518580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ffc7c-b13b-4f2e-a50c-b46e7575c396 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:55.528764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 54/115] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:25:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:55.530254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87421-460f-4aaf-b417-ca7d3e9c6760 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.530547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87421-460f-4aaf-b417-ca7d3e9c6760 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.530828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87421-460f-4aaf-b417-ca7d3e9c6760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.547773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda324c-b126-4756-b33d-af735b3ab4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.548660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda324c-b126-4756-b33d-af735b3ab4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.548974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda324c-b126-4756-b33d-af735b3ab4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.549295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda324c-b126-4756-b33d-af735b3ab4a5 None admin] PATH_INFO: `/v3/users/f08937da1a6b4e0aaa783225bc6286e5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.551431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-88f87421-460f-4aaf-b417-ca7d3e9c6760 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:55.553408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-88f87421-460f-4aaf-b417-ca7d3e9c6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:55.573317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda324c-b126-4756-b33d-af735b3ab4a5 None admin] RBAC: Authorizing `identity:get_user(user_id=f08937da1a6b4e0aaa783225bc6286e5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:55.575719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda324c-b126-4756-b33d-af735b3ab4a5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:55.578451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 62/116] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:55 2022] GET /identity/v3/users/f08937da1a6b4e0aaa783225bc6286e5 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:55.579709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda324c-b126-4756-b33d-af735b3ab4a5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:55.623616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 55/117] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:55.624944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f87421-460f-4aaf-b417-ca7d3e9c6760 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:55.704515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda324c-b126-4756-b33d-af735b3ab4a5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.735371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f87421-460f-4aaf-b417-ca7d3e9c6760 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.745135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623cc2d-7eb2-486e-828b-07762299cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.745936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623cc2d-7eb2-486e-828b-07762299cd3f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.746216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623cc2d-7eb2-486e-828b-07762299cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.746521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623cc2d-7eb2-486e-828b-07762299cd3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.760156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623cc2d-7eb2-486e-828b-07762299cd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:55.768718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445fe92-5aa8-4a2f-833a-db8b3e2ae663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.769620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445fe92-5aa8-4a2f-833a-db8b3e2ae663 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.769911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445fe92-5aa8-4a2f-833a-db8b3e2ae663 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.770182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445fe92-5aa8-4a2f-833a-db8b3e2ae663 None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.771382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445fe92-5aa8-4a2f-833a-db8b3e2ae663 None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9623cc2d-7eb2-486e-828b-07762299cd3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:55.772712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:55.773569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:55.774379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:25:55.780605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445fe92-5aa8-4a2f-833a-db8b3e2ae663 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:55.780605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 56/118] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:55 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:55.780605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445fe92-5aa8-4a2f-833a-db8b3e2ae663 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:55.780799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 63/119] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:55.782006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d9a1-2630-4a9a-8001-8e2d22c51b92 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.782397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d9a1-2630-4a9a-8001-8e2d22c51b92 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.782763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d9a1-2630-4a9a-8001-8e2d22c51b92 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.784634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 64/120] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:55.785620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1d9a1-2630-4a9a-8001-8e2d22c51b92 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:55.892992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1d9a1-2630-4a9a-8001-8e2d22c51b92 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.902953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445fe92-5aa8-4a2f-833a-db8b3e2ae663 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:55.934237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be02f2-791d-4d77-a258-4d2dc6d2545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.935032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be02f2-791d-4d77-a258-4d2dc6d2545a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.935315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be02f2-791d-4d77-a258-4d2dc6d2545a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.935734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be02f2-791d-4d77-a258-4d2dc6d2545a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:55.937061 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be02f2-791d-4d77-a258-4d2dc6d2545a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:55.938742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be02f2-791d-4d77-a258-4d2dc6d2545a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:55.939312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238c310-1ba3-443b-94b0-1386bbb8e738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:55.939969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238c310-1ba3-443b-94b0-1386bbb8e738 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:55.940251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238c310-1ba3-443b-94b0-1386bbb8e738 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:55.940669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 65/121] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:55.941494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be02f2-791d-4d77-a258-4d2dc6d2545a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:55.945025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238c310-1ba3-443b-94b0-1386bbb8e738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.009283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238c310-1ba3-443b-94b0-1386bbb8e738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.010869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238c310-1ba3-443b-94b0-1386bbb8e738 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.039427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be02f2-791d-4d77-a258-4d2dc6d2545a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.071336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.072006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.072288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.072566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.073310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:56.073641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.075041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.083013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 66/122] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:56.083811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.107521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 57/123] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:25:56.113408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0b56-3438-460d-8d50-bedf45b9e6af None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.113729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0b56-3438-460d-8d50-bedf45b9e6af None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.114030 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f0b56-3438-460d-8d50-bedf45b9e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.129841 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-866f0b56-3438-460d-8d50-bedf45b9e6af None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:56.131031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-866f0b56-3438-460d-8d50-bedf45b9e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:56.189051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c169-3265-480b-9ca2-a863f796b3a6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.198312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 58/124] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:56.207703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f0b56-3438-460d-8d50-bedf45b9e6af None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.227131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1673cf9-1457-45b1-a327-2f46ddb3305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.228010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673cf9-1457-45b1-a327-2f46ddb3305c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.228294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673cf9-1457-45b1-a327-2f46ddb3305c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.228569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673cf9-1457-45b1-a327-2f46ddb3305c None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.229793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1673cf9-1457-45b1-a327-2f46ddb3305c None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.231261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1673cf9-1457-45b1-a327-2f46ddb3305c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.233136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 67/125] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:56 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:56.233922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1673cf9-1457-45b1-a327-2f46ddb3305c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.312464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f0b56-3438-460d-8d50-bedf45b9e6af None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.334345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1673cf9-1457-45b1-a327-2f46ddb3305c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.344759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df412b-7196-46ba-9cff-ddd378d48304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.345638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df412b-7196-46ba-9cff-ddd378d48304 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.346104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df412b-7196-46ba-9cff-ddd378d48304 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.346371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df412b-7196-46ba-9cff-ddd378d48304 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.347084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df412b-7196-46ba-9cff-ddd378d48304 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.348544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df412b-7196-46ba-9cff-ddd378d48304 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.368079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baef52-361b-4319-b8d7-caa2979831bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.369048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baef52-361b-4319-b8d7-caa2979831bc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.369347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baef52-361b-4319-b8d7-caa2979831bc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.369729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baef52-361b-4319-b8d7-caa2979831bc None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.370911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baef52-361b-4319-b8d7-caa2979831bc None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.372364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baef52-361b-4319-b8d7-caa2979831bc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.374296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 68/126] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:56 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:56.374865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baef52-361b-4319-b8d7-caa2979831bc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.380485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 59/127] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:25:56 2022] POST /identity/v3/projects => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:25:56.381531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df412b-7196-46ba-9cff-ddd378d48304 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.497706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baef52-361b-4319-b8d7-caa2979831bc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.513169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df412b-7196-46ba-9cff-ddd378d48304 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.532333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd2b1e-148b-4bf1-994b-e32e757cc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.533231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd2b1e-148b-4bf1-994b-e32e757cc97d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.533504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd2b1e-148b-4bf1-994b-e32e757cc97d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.533846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd2b1e-148b-4bf1-994b-e32e757cc97d None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.535047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd2b1e-148b-4bf1-994b-e32e757cc97d None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.536708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd2b1e-148b-4bf1-994b-e32e757cc97d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.539110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 69/128] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:56 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:56.539745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd2b1e-148b-4bf1-994b-e32e757cc97d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.559603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8448d-80d8-4106-b204-11c8934ba168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.560312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8448d-80d8-4106-b204-11c8934ba168 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.560594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8448d-80d8-4106-b204-11c8934ba168 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.560870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8448d-80d8-4106-b204-11c8934ba168 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.572753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8448d-80d8-4106-b204-11c8934ba168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-36f8448d-80d8-4106-b204-11c8934ba168 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:56.580438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:56.581506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:25:56.582457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:56.583049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 60/129] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:25:56.583328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8448d-80d8-4106-b204-11c8934ba168 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.659005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd2b1e-148b-4bf1-994b-e32e757cc97d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.698137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87dc81-f03b-4a33-be1a-cdfa54687e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.699060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87dc81-f03b-4a33-be1a-cdfa54687e9a None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.699346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87dc81-f03b-4a33-be1a-cdfa54687e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.699624 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87dc81-f03b-4a33-be1a-cdfa54687e9a None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a/users/8462e07973b6479ab690bab71d456f27/roles/b2a32fa865d44fe48cd439137f78a12f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.702698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87dc81-f03b-4a33-be1a-cdfa54687e9a None admin] RBAC: Authorizing `identity:create_grant(project_id=0463b87212e547209f1edc8f93d9401a, user_id=8462e07973b6479ab690bab71d456f27, role_id=b2a32fa865d44fe48cd439137f78a12f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.704878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87dc81-f03b-4a33-be1a-cdfa54687e9a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.706869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8448d-80d8-4106-b204-11c8934ba168 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.720193 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 70/130] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:25:56 2022] PUT /identity/v3/projects/0463b87212e547209f1edc8f93d9401a/users/8462e07973b6479ab690bab71d456f27/roles/b2a32fa865d44fe48cd439137f78a12f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:25:56.721680 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87dc81-f03b-4a33-be1a-cdfa54687e9a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.746266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d8a3d-251b-4015-8847-7725870b1fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.747487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8a3d-251b-4015-8847-7725870b1fce None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.747966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8a3d-251b-4015-8847-7725870b1fce None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.748493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8a3d-251b-4015-8847-7725870b1fce None admin] PATH_INFO: `/v3/projects/bcff62d19b4c49a1a1ee02a2773f7a8f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.750128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8a3d-251b-4015-8847-7725870b1fce None admin] RBAC: Authorizing `identity:get_project(project_id=bcff62d19b4c49a1a1ee02a2773f7a8f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.751821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8a3d-251b-4015-8847-7725870b1fce None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.753939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 61/131] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:56 2022] GET /identity/v3/projects/bcff62d19b4c49a1a1ee02a2773f7a8f => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:56.754925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d8a3d-251b-4015-8847-7725870b1fce None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.842842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87dc81-f03b-4a33-be1a-cdfa54687e9a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.865962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d8a3d-251b-4015-8847-7725870b1fce None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:56.879648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.880327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.880699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.880883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.881760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] RBAC: Adding query filter params (role.id=fb8aa50542444837855b787315bea7a9, scope.project.id=0463b87212e547209f1edc8f93d9401a, user.id=f08937da1a6b4e0aaa783225bc6286e5) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:56.882378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.883598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.890238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 71/132] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:25:56 2022] GET /identity/v3/role_assignments?user.id=f08937da1a6b4e0aaa783225bc6286e5&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=fb8aa50542444837855b787315bea7a9 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:56.890983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:56.905601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:56.907027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:56.907503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:56.908000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:56.908965 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:56.909533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:56.911335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:56.922316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 62/133] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:56.928980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:57.102040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb2386-fcb0-4862-9001-576fa8599fee None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:57.150490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ff79b-e940-4509-aac0-497176a71644 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:57.165470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491769ac-a2c1-43fe-b057-0cc92bfba8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:57.166850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491769ac-a2c1-43fe-b057-0cc92bfba8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:57.167354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491769ac-a2c1-43fe-b057-0cc92bfba8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:57.167853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491769ac-a2c1-43fe-b057-0cc92bfba8a7 None admin] PATH_INFO: `/v3/users/4463e4c93e664f46a81171f07eadb93c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:57.169473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491769ac-a2c1-43fe-b057-0cc92bfba8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=4463e4c93e664f46a81171f07eadb93c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:57.171316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491769ac-a2c1-43fe-b057-0cc92bfba8a7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:57.173382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 63/134] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:56 2022] GET /identity/v3/users/4463e4c93e664f46a81171f07eadb93c => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:57.179654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491769ac-a2c1-43fe-b057-0cc92bfba8a7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:57.193471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee946-3f92-4dac-9eef-5525d88f763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:57.194513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee946-3f92-4dac-9eef-5525d88f763e None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:57.194848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee946-3f92-4dac-9eef-5525d88f763e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:57.195132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee946-3f92-4dac-9eef-5525d88f763e None admin] PATH_INFO: `/v3/projects/bcff62d19b4c49a1a1ee02a2773f7a8f/users/8462e07973b6479ab690bab71d456f27/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:57.198135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee946-3f92-4dac-9eef-5525d88f763e None admin] RBAC: Authorizing `identity:create_grant(project_id=bcff62d19b4c49a1a1ee02a2773f7a8f, user_id=8462e07973b6479ab690bab71d456f27, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:57.200107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee946-3f92-4dac-9eef-5525d88f763e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:57.219754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 72/135] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:25:56 2022] PUT /identity/v3/projects/bcff62d19b4c49a1a1ee02a2773f7a8f/users/8462e07973b6479ab690bab71d456f27/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:25:57.341144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491769ac-a2c1-43fe-b057-0cc92bfba8a7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:57.392027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e508bf-cf95-4e9d-af53-b198a5dab7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:57.393538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e508bf-cf95-4e9d-af53-b198a5dab7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:57.393887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e508bf-cf95-4e9d-af53-b198a5dab7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:57.394034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1495a-4510-40e7-9fc0-cd7016fbd006 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:57.394177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e508bf-cf95-4e9d-af53-b198a5dab7a8 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:57.394306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1495a-4510-40e7-9fc0-cd7016fbd006 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:57.394520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1495a-4510-40e7-9fc0-cd7016fbd006 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:57.396111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 73/136] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:25:57.398775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e508bf-cf95-4e9d-af53-b198a5dab7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:57.401519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e508bf-cf95-4e9d-af53-b198a5dab7a8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:57.403468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 64/137] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:57 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:57.411130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1495a-4510-40e7-9fc0-cd7016fbd006 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:57.411701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8065-fda5-44a8-b172-1e5cfd7c63ec None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:57.411987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8065-fda5-44a8-b172-1e5cfd7c63ec None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:57.412273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8065-fda5-44a8-b172-1e5cfd7c63ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:57.438994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6c3f8065-fda5-44a8-b172-1e5cfd7c63ec None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:57.440347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6c3f8065-fda5-44a8-b172-1e5cfd7c63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:57.562495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1495a-4510-40e7-9fc0-cd7016fbd006 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:57.587949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 65/138] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:25:57.599077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983252-a561-4e2f-972e-b8b00921d3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:57.599983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983252-a561-4e2f-972e-b8b00921d3a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:57.600265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983252-a561-4e2f-972e-b8b00921d3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:57.600538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983252-a561-4e2f-972e-b8b00921d3a4 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a/users/4463e4c93e664f46a81171f07eadb93c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:57.602525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983252-a561-4e2f-972e-b8b00921d3a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0463b87212e547209f1edc8f93d9401a, user_id=4463e4c93e664f46a81171f07eadb93c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:57.603981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983252-a561-4e2f-972e-b8b00921d3a4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:57.626460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 74/139] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:25:57 2022] PUT /identity/v3/projects/0463b87212e547209f1edc8f93d9401a/users/4463e4c93e664f46a81171f07eadb93c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:25:57.630440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8065-fda5-44a8-b172-1e5cfd7c63ec None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:57.735939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8065-fda5-44a8-b172-1e5cfd7c63ec None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:57.778446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618f13-3da8-4807-8563-252eaf735480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:57.779261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618f13-3da8-4807-8563-252eaf735480 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:57.779542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618f13-3da8-4807-8563-252eaf735480 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:57.779819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618f13-3da8-4807-8563-252eaf735480 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:57.791575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c618f13-3da8-4807-8563-252eaf735480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-3c618f13-3da8-4807-8563-252eaf735480 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:25:57.799665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:25:57.802566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:25:57.804526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 66/140] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:25:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:25:57.809953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983252-a561-4e2f-972e-b8b00921d3a4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:57.914051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983252-a561-4e2f-972e-b8b00921d3a4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:57.951891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:57.952651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:57.952937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:57.953220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:57.954035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:57.954347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:57.955763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:57.965171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 75/141] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:25:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:57.971446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618f13-3da8-4807-8563-252eaf735480 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:58.080066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618f13-3da8-4807-8563-252eaf735480 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:58.113799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53983c-80b8-4664-bca3-852aa0efaf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:58.114745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53983c-80b8-4664-bca3-852aa0efaf28 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:58.115027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53983c-80b8-4664-bca3-852aa0efaf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:58.115303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53983c-80b8-4664-bca3-852aa0efaf28 None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:58.116569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53983c-80b8-4664-bca3-852aa0efaf28 None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:58.118181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53983c-80b8-4664-bca3-852aa0efaf28 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:58.120046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 67/142] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:25:57 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:58.125422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:58.226371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad0dc-c0e6-4562-a167-e8e8169ccbc1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:58.259764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19707a19-da11-4f0a-b3af-80c180085d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:58.260433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707a19-da11-4f0a-b3af-80c180085d49 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:58.260715 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707a19-da11-4f0a-b3af-80c180085d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:58.260996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707a19-da11-4f0a-b3af-80c180085d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:58.335897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19707a19-da11-4f0a-b3af-80c180085d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:58.337300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19707a19-da11-4f0a-b3af-80c180085d49 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:58.443549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 76/143] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:25:58.449151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53983c-80b8-4664-bca3-852aa0efaf28 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:58.548638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53983c-80b8-4664-bca3-852aa0efaf28 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:58.582280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6bd0-1455-4c64-ba1b-48f73bdcd48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:58.583161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6bd0-1455-4c64-ba1b-48f73bdcd48b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:58.583444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6bd0-1455-4c64-ba1b-48f73bdcd48b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:58.583722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6bd0-1455-4c64-ba1b-48f73bdcd48b None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:58.584918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e6bd0-1455-4c64-ba1b-48f73bdcd48b None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:58.586451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e6bd0-1455-4c64-ba1b-48f73bdcd48b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:58.588315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 68/144] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:25:58 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:25:58.593988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19707a19-da11-4f0a-b3af-80c180085d49 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:58.698092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19707a19-da11-4f0a-b3af-80c180085d49 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:58.732130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42196-8bd6-4314-9006-8638beac5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:58.732791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42196-8bd6-4314-9006-8638beac5931 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:58.733072 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42196-8bd6-4314-9006-8638beac5931 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:58.733375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42196-8bd6-4314-9006-8638beac5931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:58.734243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42196-8bd6-4314-9006-8638beac5931 None admin] RBAC: Adding query filter params (role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=0463b87212e547209f1edc8f93d9401a, user.id=8462e07973b6479ab690bab71d456f27) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:25:58.734552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42196-8bd6-4314-9006-8638beac5931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:58.736009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42196-8bd6-4314-9006-8638beac5931 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:58.742055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 77/145] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:25:58 2022] GET /identity/v3/role_assignments?user.id=8462e07973b6479ab690bab71d456f27&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=c9deaccdca814832a7d143419fd1d54f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:59.398301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ada50-1437-4d5e-9d5d-594b7aaeb9a8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:59.398829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ada50-1437-4d5e-9d5d-594b7aaeb9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:59.398829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ada50-1437-4d5e-9d5d-594b7aaeb9a8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:59.400490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 69/146] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:25:59.405874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff664a7-6a76-4930-91a2-12ab3a24c9ae None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:59.406282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff664a7-6a76-4930-91a2-12ab3a24c9ae None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:59.406446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff664a7-6a76-4930-91a2-12ab3a24c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:59.423215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4ff664a7-6a76-4930-91a2-12ab3a24c9ae None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:25:59.424506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4ff664a7-6a76-4930-91a2-12ab3a24c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:25:59.502144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 78/147] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:25:59.540792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ada50-1437-4d5e-9d5d-594b7aaeb9a8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:59.645885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ada50-1437-4d5e-9d5d-594b7aaeb9a8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:59.679115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9017a21-a4f7-4d01-8929-02279a43f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:59.679930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017a21-a4f7-4d01-8929-02279a43f99c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:59.680215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017a21-a4f7-4d01-8929-02279a43f99c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:59.680490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9017a21-a4f7-4d01-8929-02279a43f99c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:59.681706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9017a21-a4f7-4d01-8929-02279a43f99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:59.683151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9017a21-a4f7-4d01-8929-02279a43f99c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:59.684846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 70/148] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:25:59.690424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff664a7-6a76-4930-91a2-12ab3a24c9ae None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:25:59.798347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff664a7-6a76-4930-91a2-12ab3a24c9ae None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:25:59.832187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eba37-e447-453f-bc64-df9b8a163fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:25:59.832875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eba37-e447-453f-bc64-df9b8a163fa7 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:25:59.833154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eba37-e447-453f-bc64-df9b8a163fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:25:59.833427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eba37-e447-453f-bc64-df9b8a163fa7 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:25:59.834187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eba37-e447-453f-bc64-df9b8a163fa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:25:59.835666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eba37-e447-453f-bc64-df9b8a163fa7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:25:59.862005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 79/149] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:25:59 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:00.104946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292276-32ad-4e53-93f2-8437d602ae68 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.105244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292276-32ad-4e53-93f2-8437d602ae68 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.105423 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292276-32ad-4e53-93f2-8437d602ae68 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.106844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 71/150] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:00.112783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b89cd-2f33-4038-b293-2e4660b3c487 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.113073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b89cd-2f33-4038-b293-2e4660b3c487 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.113351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b89cd-2f33-4038-b293-2e4660b3c487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.130629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-194b89cd-2f33-4038-b293-2e4660b3c487 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:00.131820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-194b89cd-2f33-4038-b293-2e4660b3c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:00.199070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 80/151] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:00.226976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292276-32ad-4e53-93f2-8437d602ae68 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:00.333057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292276-32ad-4e53-93f2-8437d602ae68 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:00.369500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fde06e-68de-461a-b72e-94143d657c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:00.370694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fde06e-68de-461a-b72e-94143d657c43 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.371161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fde06e-68de-461a-b72e-94143d657c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.371620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fde06e-68de-461a-b72e-94143d657c43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.384129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fde06e-68de-461a-b72e-94143d657c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-84fde06e-68de-461a-b72e-94143d657c43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:00.392548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:00.393465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:00.394263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:00.396806 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 72/152] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:00.406767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b89cd-2f33-4038-b293-2e4660b3c487 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:00.522778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b89cd-2f33-4038-b293-2e4660b3c487 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:00.563010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:00.563691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.563976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.564247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.564466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90845c-522b-43f4-8f1e-fd30136078f0 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.565005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:00.565313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:00.565683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90845c-522b-43f4-8f1e-fd30136078f0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.566142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90845c-522b-43f4-8f1e-fd30136078f0 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.566743 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:00.568103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 73/153] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:00.573663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030b89-7597-447f-ba94-997169fc812b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.574237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030b89-7597-447f-ba94-997169fc812b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.574696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030b89-7597-447f-ba94-997169fc812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.575900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 81/154] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:00.583486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:00.605104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0d030b89-7597-447f-ba94-997169fc812b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:00.606497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0d030b89-7597-447f-ba94-997169fc812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:00.682457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 74/155] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:00.683595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7889a5f-5910-49d5-acc9-89ae7cfa9ba8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.683883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7889a5f-5910-49d5-acc9-89ae7cfa9ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.684153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7889a5f-5910-49d5-acc9-89ae7cfa9ba8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.685411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 75/156] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:00.692722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcf93c-0880-413a-9b23-9f4ec9772e2e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.693056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcf93c-0880-413a-9b23-9f4ec9772e2e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.693339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcf93c-0880-413a-9b23-9f4ec9772e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.717525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-64bcf93c-0880-413a-9b23-9f4ec9772e2e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:00.720025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-64bcf93c-0880-413a-9b23-9f4ec9772e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:00.737646 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4a294-7a0a-492c-919b-52a820d602e8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:00.780062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886bebd-d900-4da8-b5cb-0f28f1037454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:00.781395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886bebd-d900-4da8-b5cb-0f28f1037454 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.781707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886bebd-d900-4da8-b5cb-0f28f1037454 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.781984 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886bebd-d900-4da8-b5cb-0f28f1037454 None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.783561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886bebd-d900-4da8-b5cb-0f28f1037454 None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:00.785387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886bebd-d900-4da8-b5cb-0f28f1037454 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:00.787831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 82/157] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:00 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:00.789329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886bebd-d900-4da8-b5cb-0f28f1037454 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:00.810088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 76/158] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:00.818116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcf93c-0880-413a-9b23-9f4ec9772e2e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:00.906723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886bebd-d900-4da8-b5cb-0f28f1037454 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:00.943540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcf93c-0880-413a-9b23-9f4ec9772e2e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:00.946366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808fb34-16e5-42c3-95f0-5fb8ab116079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:00.947312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808fb34-16e5-42c3-95f0-5fb8ab116079 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.947598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808fb34-16e5-42c3-95f0-5fb8ab116079 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.947867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808fb34-16e5-42c3-95f0-5fb8ab116079 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:00.963113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808fb34-16e5-42c3-95f0-5fb8ab116079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8808fb34-16e5-42c3-95f0-5fb8ab116079 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:00.972927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:00.973857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 83/159] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:00.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808fb34-16e5-42c3-95f0-5fb8ab116079 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:00.997453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b91878-b13d-4c07-8d3c-cd41b6343b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:00.998198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91878-b13d-4c07-8d3c-cd41b6343b3c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:00.998538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91878-b13d-4c07-8d3c-cd41b6343b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:00.999812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91878-b13d-4c07-8d3c-cd41b6343b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.080492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b91878-b13d-4c07-8d3c-cd41b6343b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:01.082073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b91878-b13d-4c07-8d3c-cd41b6343b3c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:01.104627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808fb34-16e5-42c3-95f0-5fb8ab116079 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:01.142681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f530e9-d198-403f-8b22-579651e69f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:01.144004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f530e9-d198-403f-8b22-579651e69f8d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.144481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f530e9-d198-403f-8b22-579651e69f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.144943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f530e9-d198-403f-8b22-579651e69f8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.156427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f530e9-d198-403f-8b22-579651e69f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e9f530e9-d198-403f-8b22-579651e69f8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:01.164641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:01.165753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:01.166601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:01.169012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 84/160] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:01.170530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0395-e386-48fc-818f-946a5fa496c5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.171083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0395-e386-48fc-818f-946a5fa496c5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.171554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e0395-e386-48fc-818f-946a5fa496c5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.173031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 85/161] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:01.174968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e0395-e386-48fc-818f-946a5fa496c5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:01.201674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 77/162] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:01.203436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175160f-5bc7-4730-9082-c3c82cf4f9c3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.203724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175160f-5bc7-4730-9082-c3c82cf4f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.204058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175160f-5bc7-4730-9082-c3c82cf4f9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.224788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e175160f-5bc7-4730-9082-c3c82cf4f9c3 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:01.226416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e175160f-5bc7-4730-9082-c3c82cf4f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:01.299217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 78/163] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:01.300232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175160f-5bc7-4730-9082-c3c82cf4f9c3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:01.342132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e0395-e386-48fc-818f-946a5fa496c5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:01.380950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:01.381653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.381933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.382204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.382950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:01.383253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:01.384694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:01.393207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 86/164] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:01.397590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:01.460847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175160f-5bc7-4730-9082-c3c82cf4f9c3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:01.495524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:01.496566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.497047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.497530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.498555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:01.499129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:01.500718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:01.509284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 79/165] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:01.510422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:01.525957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87455758-84a4-4396-8892-8ef731d7659e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:01.587177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53d557-6515-4e01-8b07-935a415fc713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:01.587908 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d557-6515-4e01-8b07-935a415fc713 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.588189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d557-6515-4e01-8b07-935a415fc713 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.588506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53d557-6515-4e01-8b07-935a415fc713 None admin] PATH_INFO: `/v3/projects/bcff62d19b4c49a1a1ee02a2773f7a8f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.589734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53d557-6515-4e01-8b07-935a415fc713 None admin] RBAC: Authorizing `identity:get_project(project_id=bcff62d19b4c49a1a1ee02a2773f7a8f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:01.591191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53d557-6515-4e01-8b07-935a415fc713 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:01.593439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 87/166] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/projects/bcff62d19b4c49a1a1ee02a2773f7a8f => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:01.597391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53d557-6515-4e01-8b07-935a415fc713 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:01.611327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fa967-265f-4f43-9ebe-adc7a2509e6a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:01.648895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1eb6a-4080-419d-8f81-26035551ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:01.650165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1eb6a-4080-419d-8f81-26035551ab8c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.650642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1eb6a-4080-419d-8f81-26035551ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.651115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1eb6a-4080-419d-8f81-26035551ab8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.663103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1eb6a-4080-419d-8f81-26035551ab8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-6bb1eb6a-4080-419d-8f81-26035551ab8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:01.671270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:01.672156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:01.672919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:01.675640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 80/167] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:01.676623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1eb6a-4080-419d-8f81-26035551ab8c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:01.783146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1eb6a-4080-419d-8f81-26035551ab8c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:01.817605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f2a12-f8ca-484a-b7d4-d458b3a78873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:01.818884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f2a12-f8ca-484a-b7d4-d458b3a78873 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.819759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f2a12-f8ca-484a-b7d4-d458b3a78873 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.820243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f2a12-f8ca-484a-b7d4-d458b3a78873 None admin] PATH_INFO: `/v3/users/f08937da1a6b4e0aaa783225bc6286e5` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.821795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f2a12-f8ca-484a-b7d4-d458b3a78873 None admin] RBAC: Authorizing `identity:get_user(user_id=f08937da1a6b4e0aaa783225bc6286e5)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:01.823600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f2a12-f8ca-484a-b7d4-d458b3a78873 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:01.825466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 81/168] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/users/f08937da1a6b4e0aaa783225bc6286e5 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:01.826605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f2a12-f8ca-484a-b7d4-d458b3a78873 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:01.840333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53d557-6515-4e01-8b07-935a415fc713 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:01.908844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208c02-8562-480d-b95a-abc2d0325fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:01.909753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208c02-8562-480d-b95a-abc2d0325fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.910018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208c02-8562-480d-b95a-abc2d0325fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.910285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208c02-8562-480d-b95a-abc2d0325fe5 None admin] PATH_INFO: `/v3/users/8462e07973b6479ab690bab71d456f27` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.914912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208c02-8562-480d-b95a-abc2d0325fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=8462e07973b6479ab690bab71d456f27)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:01.916653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208c02-8562-480d-b95a-abc2d0325fe5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:01.918134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 88/169] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/users/8462e07973b6479ab690bab71d456f27 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:01.918936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208c02-8562-480d-b95a-abc2d0325fe5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:01.936740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f2a12-f8ca-484a-b7d4-d458b3a78873 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:01.974945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:01.976092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:01.976701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:01.977197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:01.978274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] RBAC: Adding query filter params (role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=bcff62d19b4c49a1a1ee02a2773f7a8f, user.id=8462e07973b6479ab690bab71d456f27) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:01.978895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:01.980526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:01.996011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 82/170] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/role_assignments?user.id=8462e07973b6479ab690bab71d456f27&scope.project.id=bcff62d19b4c49a1a1ee02a2773f7a8f&role.id=c9deaccdca814832a7d143419fd1d54f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:01.998413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.110103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1896cf-02ed-4ebe-b512-f1e33d6b971e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.148343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac304-a78e-4657-88a9-b6642f27a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.149231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac304-a78e-4657-88a9-b6642f27a288 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.149503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac304-a78e-4657-88a9-b6642f27a288 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.149808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac304-a78e-4657-88a9-b6642f27a288 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.151096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ac304-a78e-4657-88a9-b6642f27a288 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.152557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ac304-a78e-4657-88a9-b6642f27a288 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:02.154496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 83/171] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:02.155567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac304-a78e-4657-88a9-b6642f27a288 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.194413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208c02-8562-480d-b95a-abc2d0325fe5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.264637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac304-a78e-4657-88a9-b6642f27a288 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.286371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.287066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.287342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.287611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.288373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:02.288675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.290151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:02.304333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88385bf5-e5c4-438b-806f-7698c1181d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.305004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385bf5-e5c4-438b-806f-7698c1181d8b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.305278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385bf5-e5c4-438b-806f-7698c1181d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.305559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385bf5-e5c4-438b-806f-7698c1181d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.308820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 89/172] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:02.309654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.391098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88385bf5-e5c4-438b-806f-7698c1181d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.393514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88385bf5-e5c4-438b-806f-7698c1181d8b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:02.537313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b8c1-e7cc-4072-b8d2-b1cf2ab174b4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.544972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 84/173] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:02.550353 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88385bf5-e5c4-438b-806f-7698c1181d8b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.606290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfed48-efbb-45e3-a725-419401a897d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.607205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfed48-efbb-45e3-a725-419401a897d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.607470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfed48-efbb-45e3-a725-419401a897d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.607738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfed48-efbb-45e3-a725-419401a897d6 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a/users/f08937da1a6b4e0aaa783225bc6286e5/roles/fb8aa50542444837855b787315bea7a9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.609865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfed48-efbb-45e3-a725-419401a897d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0463b87212e547209f1edc8f93d9401a, user_id=f08937da1a6b4e0aaa783225bc6286e5, role_id=fb8aa50542444837855b787315bea7a9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.611310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfed48-efbb-45e3-a725-419401a897d6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:02.640113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 90/174] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:02 2022] PUT /identity/v3/projects/0463b87212e547209f1edc8f93d9401a/users/f08937da1a6b4e0aaa783225bc6286e5/roles/fb8aa50542444837855b787315bea7a9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:02.640742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfed48-efbb-45e3-a725-419401a897d6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.652862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88385bf5-e5c4-438b-806f-7698c1181d8b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.702477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff897a5-c497-4434-91c6-23c3b4c7b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.703424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff897a5-c497-4434-91c6-23c3b4c7b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.703711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff897a5-c497-4434-91c6-23c3b4c7b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.703985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff897a5-c497-4434-91c6-23c3b4c7b5d1 None admin] PATH_INFO: `/v3/users/4463e4c93e664f46a81171f07eadb93c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.705597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff897a5-c497-4434-91c6-23c3b4c7b5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=4463e4c93e664f46a81171f07eadb93c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.707058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff897a5-c497-4434-91c6-23c3b4c7b5d1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:02.708952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 85/175] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:02 2022] GET /identity/v3/users/4463e4c93e664f46a81171f07eadb93c => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:02.714514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff897a5-c497-4434-91c6-23c3b4c7b5d1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.761890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfed48-efbb-45e3-a725-419401a897d6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.798912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52af9a-e264-4e25-af36-22773c50a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.799884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52af9a-e264-4e25-af36-22773c50a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.800169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52af9a-e264-4e25-af36-22773c50a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.800438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52af9a-e264-4e25-af36-22773c50a0e6 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.801747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52af9a-e264-4e25-af36-22773c50a0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.803672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52af9a-e264-4e25-af36-22773c50a0e6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:02.805578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 91/176] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:02 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:02.824362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52af9a-e264-4e25-af36-22773c50a0e6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.841059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff897a5-c497-4434-91c6-23c3b4c7b5d1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.885269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35469d23-d363-4f16-ac0b-41535a00e1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.886004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35469d23-d363-4f16-ac0b-41535a00e1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.886287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35469d23-d363-4f16-ac0b-41535a00e1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.886564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35469d23-d363-4f16-ac0b-41535a00e1f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.949706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52af9a-e264-4e25-af36-22773c50a0e6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.992320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.993079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.993354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.993696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.994618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] RBAC: Adding query filter params (role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=0463b87212e547209f1edc8f93d9401a, user.id=8462e07973b6479ab690bab71d456f27) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:02.994989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.996515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:03.003842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 92/177] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:02 2022] GET /identity/v3/role_assignments?user.id=8462e07973b6479ab690bab71d456f27&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:03.041826 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35469d23-d363-4f16-ac0b-41535a00e1f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:03.043753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35469d23-d363-4f16-ac0b-41535a00e1f3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:03.191739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 86/178] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 17:26:03.197624 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:03.334061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b66ee-be2e-48e6-a352-01d793bfabbb None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.334815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b66ee-be2e-48e6-a352-01d793bfabbb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.335310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b66ee-be2e-48e6-a352-01d793bfabbb None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.337235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 87/179] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:03.343075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49dc74-cfd6-4a99-9cc6-36dbef892686 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.343630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49dc74-cfd6-4a99-9cc6-36dbef892686 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.344121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49dc74-cfd6-4a99-9cc6-36dbef892686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.353049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778bf6-04d8-49f1-a0b1-d98310b1b732 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:03.374670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8b49dc74-cfd6-4a99-9cc6-36dbef892686 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:03.376270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8b49dc74-cfd6-4a99-9cc6-36dbef892686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:03.398897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f3dd-0a8c-48ff-9574-be76bc1e7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:03.399829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f3dd-0a8c-48ff-9574-be76bc1e7418 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.400125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f3dd-0a8c-48ff-9574-be76bc1e7418 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.400403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f3dd-0a8c-48ff-9574-be76bc1e7418 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.401869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7f3dd-0a8c-48ff-9574-be76bc1e7418 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:03.403869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7f3dd-0a8c-48ff-9574-be76bc1e7418 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:03.406056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 93/180] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:03 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:03.413105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f3dd-0a8c-48ff-9574-be76bc1e7418 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:03.504772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 88/181] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:03.530943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49dc74-cfd6-4a99-9cc6-36dbef892686 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:03.621489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f3dd-0a8c-48ff-9574-be76bc1e7418 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:03.657301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49dc74-cfd6-4a99-9cc6-36dbef892686 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:03.696713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223c36f-e574-4312-b62f-a0ea2cb44b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:03.697842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c36f-e574-4312-b62f-a0ea2cb44b47 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.698590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c36f-e574-4312-b62f-a0ea2cb44b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.699042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c36f-e574-4312-b62f-a0ea2cb44b47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.710940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223c36f-e574-4312-b62f-a0ea2cb44b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:03.718290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fa17a-0dab-4967-abe8-ce385b8f2964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:03.719007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fa17a-0dab-4967-abe8-ce385b8f2964 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.719286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fa17a-0dab-4967-abe8-ce385b8f2964 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.719554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fa17a-0dab-4967-abe8-ce385b8f2964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a223c36f-e574-4312-b62f-a0ea2cb44b47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:03.719882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:03.720932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:03.721937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:03.722563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fa17a-0dab-4967-abe8-ce385b8f2964 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=0463b87212e547209f1edc8f93d9401a, user.id=4463e4c93e664f46a81171f07eadb93c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:03.722563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fa17a-0dab-4967-abe8-ce385b8f2964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:03.722563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fa17a-0dab-4967-abe8-ce385b8f2964 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:03.724712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 89/182] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:03.730404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223c36f-e574-4312-b62f-a0ea2cb44b47 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:03.736230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 94/183] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:03 2022] GET /identity/v3/role_assignments?user.id=4463e4c93e664f46a81171f07eadb93c&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:03.783988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0444-57a5-4a61-92a5-63eae9fd5e36 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.784188 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0444-57a5-4a61-92a5-63eae9fd5e36 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.784463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0444-57a5-4a61-92a5-63eae9fd5e36 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.786016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 95/184] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:03.795232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a826a7-35d0-4251-a594-e35e58e67535 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.795600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a826a7-35d0-4251-a594-e35e58e67535 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.795860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a826a7-35d0-4251-a594-e35e58e67535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.842875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c6a826a7-35d0-4251-a594-e35e58e67535 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:03.844476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c6a826a7-35d0-4251-a594-e35e58e67535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:03.851945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223c36f-e574-4312-b62f-a0ea2cb44b47 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:03.893715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:03.895406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.895934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.896384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.897358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:03.897868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:03.899955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:03.911389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 90/185] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:03.917347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:03.997602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 96/186] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:04.021930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a826a7-35d0-4251-a594-e35e58e67535 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.033985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580f7f-3c0b-416e-b14f-9af3ebd4cbdc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.076991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bdb32-48bc-4cb7-9769-64a9f17aa7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.078414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bdb32-48bc-4cb7-9769-64a9f17aa7cf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.078960 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bdb32-48bc-4cb7-9769-64a9f17aa7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.079239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bdb32-48bc-4cb7-9769-64a9f17aa7cf None admin] PATH_INFO: `/v3/users/4454d45d26394fe196c2c9c2a3e81e52` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.099909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bdb32-48bc-4cb7-9769-64a9f17aa7cf None admin] RBAC: Authorizing `identity:get_user(user_id=4454d45d26394fe196c2c9c2a3e81e52)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.101523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bdb32-48bc-4cb7-9769-64a9f17aa7cf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.104758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 91/187] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:03 2022] GET /identity/v3/users/4454d45d26394fe196c2c9c2a3e81e52 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:04.110246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bdb32-48bc-4cb7-9769-64a9f17aa7cf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.130803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a826a7-35d0-4251-a594-e35e58e67535 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.170067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df153-3a50-4721-8c5a-dfbcd01a1a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.170951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df153-3a50-4721-8c5a-dfbcd01a1a9d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.171231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df153-3a50-4721-8c5a-dfbcd01a1a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.171503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df153-3a50-4721-8c5a-dfbcd01a1a9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.181842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6df153-3a50-4721-8c5a-dfbcd01a1a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9f6df153-3a50-4721-8c5a-dfbcd01a1a9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:04.189861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:04.190764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:04.191580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 97/188] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:04.194522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8e07-b255-461e-a7d8-c5d3b1ec5d4b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.194819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8e07-b255-461e-a7d8-c5d3b1ec5d4b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.195122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8e07-b255-461e-a7d8-c5d3b1ec5d4b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.196464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 98/189] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:04.197150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8e07-b255-461e-a7d8-c5d3b1ec5d4b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.218885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bdb32-48bc-4cb7-9769-64a9f17aa7cf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.251850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf366e7e-3d16-4b0e-b60d-d4d55f814da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.252516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf366e7e-3d16-4b0e-b60d-d4d55f814da3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.252791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf366e7e-3d16-4b0e-b60d-d4d55f814da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.253065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf366e7e-3d16-4b0e-b60d-d4d55f814da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.299286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8e07-b255-461e-a7d8-c5d3b1ec5d4b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.329180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf366e7e-3d16-4b0e-b60d-d4d55f814da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.330613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf366e7e-3d16-4b0e-b60d-d4d55f814da3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.336380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bc3e2-ceca-43ea-b495-d534b54005fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.337089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bc3e2-ceca-43ea-b495-d534b54005fb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.337368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bc3e2-ceca-43ea-b495-d534b54005fb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.337675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bc3e2-ceca-43ea-b495-d534b54005fb None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.338447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bc3e2-ceca-43ea-b495-d534b54005fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:04.338757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bc3e2-ceca-43ea-b495-d534b54005fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.340201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bc3e2-ceca-43ea-b495-d534b54005fb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.348666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 99/190] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:04.349638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4b2fb-3858-4e38-8388-f366f415087d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.349922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4b2fb-3858-4e38-8388-f366f415087d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.350200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4b2fb-3858-4e38-8388-f366f415087d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.367164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1fb4b2fb-3858-4e38-8388-f366f415087d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:04.368334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1fb4b2fb-3858-4e38-8388-f366f415087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:04.432821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 100/191] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:04.433478 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4b2fb-3858-4e38-8388-f366f415087d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.435086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 92/192] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 17:26:04.440760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf366e7e-3d16-4b0e-b60d-d4d55f814da3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.536559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf366e7e-3d16-4b0e-b60d-d4d55f814da3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.542464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4b2fb-3858-4e38-8388-f366f415087d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.572385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6703da6-389f-4705-b1ba-0362e3c4b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.573306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6703da6-389f-4705-b1ba-0362e3c4b9bf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.573611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6703da6-389f-4705-b1ba-0362e3c4b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.573878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6703da6-389f-4705-b1ba-0362e3c4b9bf None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.575082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6703da6-389f-4705-b1ba-0362e3c4b9bf None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.576576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6703da6-389f-4705-b1ba-0362e3c4b9bf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.578176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dff4e5-84b2-4128-a522-d1dcb890da3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.578382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 93/193] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:04.579106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6703da6-389f-4705-b1ba-0362e3c4b9bf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.579863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dff4e5-84b2-4128-a522-d1dcb890da3b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.580138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dff4e5-84b2-4128-a522-d1dcb890da3b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.580491 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dff4e5-84b2-4128-a522-d1dcb890da3b None admin] PATH_INFO: `/v3/users/4454d45d26394fe196c2c9c2a3e81e52` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.582651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dff4e5-84b2-4128-a522-d1dcb890da3b None admin] RBAC: Authorizing `identity:get_user(user_id=4454d45d26394fe196c2c9c2a3e81e52)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.584127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dff4e5-84b2-4128-a522-d1dcb890da3b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.585869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 101/194] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/users/4454d45d26394fe196c2c9c2a3e81e52 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:04.587080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dff4e5-84b2-4128-a522-d1dcb890da3b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.679222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6703da6-389f-4705-b1ba-0362e3c4b9bf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.684616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dff4e5-84b2-4128-a522-d1dcb890da3b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.711793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001e0d-01af-4f59-bb5e-d140be08dcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.712646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001e0d-01af-4f59-bb5e-d140be08dcfb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.712877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001e0d-01af-4f59-bb5e-d140be08dcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.713145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001e0d-01af-4f59-bb5e-d140be08dcfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.714306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001e0d-01af-4f59-bb5e-d140be08dcfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.715757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001e0d-01af-4f59-bb5e-d140be08dcfb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.717462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 94/195] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:04.719283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.720164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.720629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.721098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.721855 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001e0d-01af-4f59-bb5e-d140be08dcfb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.722575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=938f6968326342b59e88886f73e95b00, user.id=4454d45d26394fe196c2c9c2a3e81e52) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:04.722890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.724332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.730180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 102/196] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/role_assignments?user.id=4454d45d26394fe196c2c9c2a3e81e52&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:04.742686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.831303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001e0d-01af-4f59-bb5e-d140be08dcfb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.862605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935481e-4f74-4e4b-b1e3-20bd18e810c9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.869143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963ffb8-fa3a-466d-b5d2-d1ea0343627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.869844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963ffb8-fa3a-466d-b5d2-d1ea0343627e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.870126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963ffb8-fa3a-466d-b5d2-d1ea0343627e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.870403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963ffb8-fa3a-466d-b5d2-d1ea0343627e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.900658 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aabb9-7941-4798-8bd2-3d970ffbad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.901482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aabb9-7941-4798-8bd2-3d970ffbad67 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.901798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aabb9-7941-4798-8bd2-3d970ffbad67 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.902066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aabb9-7941-4798-8bd2-3d970ffbad67 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.902821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aabb9-7941-4798-8bd2-3d970ffbad67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.904422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aabb9-7941-4798-8bd2-3d970ffbad67 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.930108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 103/197] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:04 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:04.954109 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963ffb8-fa3a-466d-b5d2-d1ea0343627e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.955777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963ffb8-fa3a-466d-b5d2-d1ea0343627e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:05.078577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 95/198] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:05.084415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aabb9-7941-4798-8bd2-3d970ffbad67 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:05.193010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aabb9-7941-4798-8bd2-3d970ffbad67 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:05.232604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696bf42-500d-42bf-85ea-e22e4a7ba0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:05.233781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696bf42-500d-42bf-85ea-e22e4a7ba0ce None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:05.234062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696bf42-500d-42bf-85ea-e22e4a7ba0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:05.234332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696bf42-500d-42bf-85ea-e22e4a7ba0ce None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:05.235617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696bf42-500d-42bf-85ea-e22e4a7ba0ce None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:05.237133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696bf42-500d-42bf-85ea-e22e4a7ba0ce None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:05.238942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 104/199] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:05 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:05.245059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963ffb8-fa3a-466d-b5d2-d1ea0343627e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:05.358049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963ffb8-fa3a-466d-b5d2-d1ea0343627e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:05.401542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330567d2-2211-45ec-afd8-b081eacdf7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:05.402252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330567d2-2211-45ec-afd8-b081eacdf7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:05.402527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330567d2-2211-45ec-afd8-b081eacdf7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:05.402791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330567d2-2211-45ec-afd8-b081eacdf7f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:05.403627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330567d2-2211-45ec-afd8-b081eacdf7f5 None admin] RBAC: Adding query filter params (role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=938f6968326342b59e88886f73e95b00, user.id=4454d45d26394fe196c2c9c2a3e81e52) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:05.403934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330567d2-2211-45ec-afd8-b081eacdf7f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:05.405478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330567d2-2211-45ec-afd8-b081eacdf7f5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:05.411324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 96/200] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:05 2022] GET /identity/v3/role_assignments?user.id=4454d45d26394fe196c2c9c2a3e81e52&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:05.459240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554c33-c951-4738-903e-0f34bc5cf025 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:05.459580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554c33-c951-4738-903e-0f34bc5cf025 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:05.459799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554c33-c951-4738-903e-0f34bc5cf025 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:05.461605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 105/201] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:05.468238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002670-6dae-4e6a-bb67-0efa64fede7d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:05.468817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002670-6dae-4e6a-bb67-0efa64fede7d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:05.469312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002670-6dae-4e6a-bb67-0efa64fede7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:05.494428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f2002670-6dae-4e6a-bb67-0efa64fede7d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:05.495730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f2002670-6dae-4e6a-bb67-0efa64fede7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:05.607710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 97/202] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:05.642876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554c33-c951-4738-903e-0f34bc5cf025 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:05.762733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554c33-c951-4738-903e-0f34bc5cf025 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:05.809373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2c833-dd31-43a2-873a-e036a3a393da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:05.810656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c833-dd31-43a2-873a-e036a3a393da None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:05.811151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c833-dd31-43a2-873a-e036a3a393da None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:05.811611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c833-dd31-43a2-873a-e036a3a393da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:05.822308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2c833-dd31-43a2-873a-e036a3a393da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2de2c833-dd31-43a2-873a-e036a3a393da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:05.830487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:05.831401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:05.832234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:05.834966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 106/203] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:05.843149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002670-6dae-4e6a-bb67-0efa64fede7d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:05.971212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002670-6dae-4e6a-bb67-0efa64fede7d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:06.014368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:06.015118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:06.015404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:06.015679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:06.016473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:06.016790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:06.018263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:06.027371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 98/204] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:06.037366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2c833-dd31-43a2-873a-e036a3a393da None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:06.193694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2c833-dd31-43a2-873a-e036a3a393da None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:06.234643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622649ec-26ad-4a3e-bef2-f3d2a79df6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:06.235907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622649ec-26ad-4a3e-bef2-f3d2a79df6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:06.236379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622649ec-26ad-4a3e-bef2-f3d2a79df6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:06.236836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622649ec-26ad-4a3e-bef2-f3d2a79df6f3 None admin] PATH_INFO: `/v3/users/f08937da1a6b4e0aaa783225bc6286e5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:06.238270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622649ec-26ad-4a3e-bef2-f3d2a79df6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=f08937da1a6b4e0aaa783225bc6286e5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:06.240115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622649ec-26ad-4a3e-bef2-f3d2a79df6f3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:06.242393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 107/205] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:06 2022] GET /identity/v3/users/f08937da1a6b4e0aaa783225bc6286e5 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:06.247852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:06.370521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c93dc-b8fb-422a-bea2-23f3f095b615 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:06.408927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6befa3-322e-49ef-852e-18e32684a11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:06.409607 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6befa3-322e-49ef-852e-18e32684a11e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:06.409891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6befa3-322e-49ef-852e-18e32684a11e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:06.410162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6befa3-322e-49ef-852e-18e32684a11e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:06.479611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6befa3-322e-49ef-852e-18e32684a11e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:06.481131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6befa3-322e-49ef-852e-18e32684a11e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:06.582806 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 99/206] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:06.588221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622649ec-26ad-4a3e-bef2-f3d2a79df6f3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:06.728458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622649ec-26ad-4a3e-bef2-f3d2a79df6f3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:06.762083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc975ec-04a3-4a2c-8d35-57dc483143b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:06.763342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc975ec-04a3-4a2c-8d35-57dc483143b1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:06.764339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc975ec-04a3-4a2c-8d35-57dc483143b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:06.764800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc975ec-04a3-4a2c-8d35-57dc483143b1 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:06.766206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc975ec-04a3-4a2c-8d35-57dc483143b1 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:06.767909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc975ec-04a3-4a2c-8d35-57dc483143b1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:06.770215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 108/207] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:06 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:06.775778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6befa3-322e-49ef-852e-18e32684a11e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:06.895763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6befa3-322e-49ef-852e-18e32684a11e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:06.937094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67493149-57d7-494a-9791-66605628ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:06.937812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493149-57d7-494a-9791-66605628ca3d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:06.938095 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493149-57d7-494a-9791-66605628ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:06.938377 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493149-57d7-494a-9791-66605628ca3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:06.939222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67493149-57d7-494a-9791-66605628ca3d None admin] RBAC: Adding query filter params (role.id=fb8aa50542444837855b787315bea7a9, scope.project.id=0463b87212e547209f1edc8f93d9401a, user.id=f08937da1a6b4e0aaa783225bc6286e5) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:06.939531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67493149-57d7-494a-9791-66605628ca3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:06.941022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67493149-57d7-494a-9791-66605628ca3d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:06.947847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 100/208] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:06 2022] GET /identity/v3/role_assignments?user.id=f08937da1a6b4e0aaa783225bc6286e5&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=fb8aa50542444837855b787315bea7a9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:07.324968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296acbf-fe4c-4ee2-9bbc-782144dad588 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.325708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296acbf-fe4c-4ee2-9bbc-782144dad588 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.326204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296acbf-fe4c-4ee2-9bbc-782144dad588 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.327918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 109/209] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:07.335189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10493-0e89-4478-bfff-4e0471f5c88a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.335515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10493-0e89-4478-bfff-4e0471f5c88a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.335792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10493-0e89-4478-bfff-4e0471f5c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.360164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c7c10493-0e89-4478-bfff-4e0471f5c88a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:07.361366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c7c10493-0e89-4478-bfff-4e0471f5c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:07.436061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 101/210] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:07.459052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296acbf-fe4c-4ee2-9bbc-782144dad588 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:07.578048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296acbf-fe4c-4ee2-9bbc-782144dad588 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:07.623080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38e498-92a4-405b-9d53-4bca604cf786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:07.624054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38e498-92a4-405b-9d53-4bca604cf786 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.624328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38e498-92a4-405b-9d53-4bca604cf786 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.624590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38e498-92a4-405b-9d53-4bca604cf786 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.637906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38e498-92a4-405b-9d53-4bca604cf786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bf38e498-92a4-405b-9d53-4bca604cf786 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:07.645918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:07.646885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:07.647686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 110/211] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:07.656106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c10493-0e89-4478-bfff-4e0471f5c88a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:07.763473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c10493-0e89-4478-bfff-4e0471f5c88a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:07.802597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a14e9d-5583-4b9c-b43b-e841fe7f85ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:07.803701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a14e9d-5583-4b9c-b43b-e841fe7f85ec None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.804189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a14e9d-5583-4b9c-b43b-e841fe7f85ec None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.804640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a14e9d-5583-4b9c-b43b-e841fe7f85ec None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.805633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a14e9d-5583-4b9c-b43b-e841fe7f85ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:07.806125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a14e9d-5583-4b9c-b43b-e841fe7f85ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:07.807753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a14e9d-5583-4b9c-b43b-e841fe7f85ec None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:07.816931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 102/212] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:07.826630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38e498-92a4-405b-9d53-4bca604cf786 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:07.827130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219a98-b33a-4cc7-9dfb-3ea186c223a7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.827319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219a98-b33a-4cc7-9dfb-3ea186c223a7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.827680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219a98-b33a-4cc7-9dfb-3ea186c223a7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.829219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 103/213] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:07.834363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2153e-89d6-4e4b-a25d-5704a1225636 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.834644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2153e-89d6-4e4b-a25d-5704a1225636 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.834910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2153e-89d6-4e4b-a25d-5704a1225636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.852665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7db2153e-89d6-4e4b-a25d-5704a1225636 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:07.857728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7db2153e-89d6-4e4b-a25d-5704a1225636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:07.937688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 104/214] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:07.944545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38e498-92a4-405b-9d53-4bca604cf786 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:07.959238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6ccc3-6bd6-4794-b626-209520004b12 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.959541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6ccc3-6bd6-4794-b626-209520004b12 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.959790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6ccc3-6bd6-4794-b626-209520004b12 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.961348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 105/215] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:07.963828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6ccc3-6bd6-4794-b626-209520004b12 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:07.984517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2a8f0-251a-4b0f-8d48-6d2b9b444d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:07.985404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2a8f0-251a-4b0f-8d48-6d2b9b444d04 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.985719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2a8f0-251a-4b0f-8d48-6d2b9b444d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.985993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2a8f0-251a-4b0f-8d48-6d2b9b444d04 None admin] PATH_INFO: `/v3/users/4454d45d26394fe196c2c9c2a3e81e52` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.987161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2a8f0-251a-4b0f-8d48-6d2b9b444d04 None admin] RBAC: Authorizing `identity:get_user(user_id=4454d45d26394fe196c2c9c2a3e81e52)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:07.988616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2a8f0-251a-4b0f-8d48-6d2b9b444d04 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:07.995343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 111/216] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:07 2022] GET /identity/v3/users/4454d45d26394fe196c2c9c2a3e81e52 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:07.995343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b399a-628b-405f-9e1b-1f0e70ce31d6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.995343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b399a-628b-405f-9e1b-1f0e70ce31d6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.995343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b399a-628b-405f-9e1b-1f0e70ce31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.007793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-420b399a-628b-405f-9e1b-1f0e70ce31d6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:08.008982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-420b399a-628b-405f-9e1b-1f0e70ce31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:08.071547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6ccc3-6bd6-4794-b626-209520004b12 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.078463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 112/217] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:08.079559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b399a-628b-405f-9e1b-1f0e70ce31d6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.108219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7477a0-ebea-4e73-82c6-352e23255b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.109323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7477a0-ebea-4e73-82c6-352e23255b14 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.109630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7477a0-ebea-4e73-82c6-352e23255b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.109906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7477a0-ebea-4e73-82c6-352e23255b14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.120189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7477a0-ebea-4e73-82c6-352e23255b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8f7477a0-ebea-4e73-82c6-352e23255b14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:08.128000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:08.128937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 106/218] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:08.134316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7477a0-ebea-4e73-82c6-352e23255b14 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.202391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b399a-628b-405f-9e1b-1f0e70ce31d6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.239952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7477a0-ebea-4e73-82c6-352e23255b14 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.244244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f991c-39ca-47ec-8c81-02fda7ad44b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.245252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f991c-39ca-47ec-8c81-02fda7ad44b7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.245561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f991c-39ca-47ec-8c81-02fda7ad44b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.245841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f991c-39ca-47ec-8c81-02fda7ad44b7 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.247127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f991c-39ca-47ec-8c81-02fda7ad44b7 None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.248696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f991c-39ca-47ec-8c81-02fda7ad44b7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.250651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 113/219] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:08.251284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f991c-39ca-47ec-8c81-02fda7ad44b7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.273284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1fb8f-655b-4aee-b8f0-521952ce0ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.274145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1fb8f-655b-4aee-b8f0-521952ce0ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.274422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1fb8f-655b-4aee-b8f0-521952ce0ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.274687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1fb8f-655b-4aee-b8f0-521952ce0ea3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.275878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1fb8f-655b-4aee-b8f0-521952ce0ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.277370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1fb8f-655b-4aee-b8f0-521952ce0ea3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.279011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 107/220] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:08.280275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa40d-761f-440b-b071-63fdc21ca969 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.280553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa40d-761f-440b-b071-63fdc21ca969 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.280822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa40d-761f-440b-b071-63fdc21ca969 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.282055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 108/221] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:08.286385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa40d-761f-440b-b071-63fdc21ca969 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.353518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f991c-39ca-47ec-8c81-02fda7ad44b7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.385150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.385564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa40d-761f-440b-b071-63fdc21ca969 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.386024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.386345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.386632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.387392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:08.387700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.389178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.397445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 114/222] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:08.398275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.418681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503da57a-d01a-452f-88e4-7c0ee6250a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.419622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503da57a-d01a-452f-88e4-7c0ee6250a38 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.419888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503da57a-d01a-452f-88e4-7c0ee6250a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.420137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503da57a-d01a-452f-88e4-7c0ee6250a38 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00/users/4454d45d26394fe196c2c9c2a3e81e52/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.422198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503da57a-d01a-452f-88e4-7c0ee6250a38 None admin] RBAC: Authorizing `identity:create_grant(project_id=938f6968326342b59e88886f73e95b00, user_id=4454d45d26394fe196c2c9c2a3e81e52, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.423654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503da57a-d01a-452f-88e4-7c0ee6250a38 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.437093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 109/223] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:08 2022] PUT /identity/v3/projects/938f6968326342b59e88886f73e95b00/users/4454d45d26394fe196c2c9c2a3e81e52/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:08.438347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447033-6548-4f0c-9c68-d4f61266025d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.438623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447033-6548-4f0c-9c68-d4f61266025d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.438894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447033-6548-4f0c-9c68-d4f61266025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.457059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-93447033-6548-4f0c-9c68-d4f61266025d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:08.458372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-93447033-6548-4f0c-9c68-d4f61266025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:08.506827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812443-a73f-444e-a472-f478c015dcc6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.530397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 110/224] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:08.538697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447033-6548-4f0c-9c68-d4f61266025d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.548590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ccf07-6bed-480a-b3c2-2a895b8b1268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.549966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ccf07-6bed-480a-b3c2-2a895b8b1268 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.550444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ccf07-6bed-480a-b3c2-2a895b8b1268 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.550972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ccf07-6bed-480a-b3c2-2a895b8b1268 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.552248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ccf07-6bed-480a-b3c2-2a895b8b1268 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.554125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ccf07-6bed-480a-b3c2-2a895b8b1268 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.577270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 115/225] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:08 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:08.578147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ccf07-6bed-480a-b3c2-2a895b8b1268 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.653357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447033-6548-4f0c-9c68-d4f61266025d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.689943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054216aa-8544-43f4-8bc0-c20376e0d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.690826 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054216aa-8544-43f4-8bc0-c20376e0d844 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.691097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054216aa-8544-43f4-8bc0-c20376e0d844 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.691359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054216aa-8544-43f4-8bc0-c20376e0d844 None admin] PATH_INFO: `/v3/users/aba024e85ab84cea9832c232f9bd2610` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.698437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ccf07-6bed-480a-b3c2-2a895b8b1268 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.705500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054216aa-8544-43f4-8bc0-c20376e0d844 None admin] RBAC: Authorizing `identity:get_user(user_id=aba024e85ab84cea9832c232f9bd2610)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.707021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054216aa-8544-43f4-8bc0-c20376e0d844 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.709087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 111/226] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/users/aba024e85ab84cea9832c232f9bd2610 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:08.715103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054216aa-8544-43f4-8bc0-c20376e0d844 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.736038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802259-b3ed-460f-8cc9-1a6dcbdca9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.736859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802259-b3ed-460f-8cc9-1a6dcbdca9cb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.737134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802259-b3ed-460f-8cc9-1a6dcbdca9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.737405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802259-b3ed-460f-8cc9-1a6dcbdca9cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.749358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea802259-b3ed-460f-8cc9-1a6dcbdca9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ea802259-b3ed-460f-8cc9-1a6dcbdca9cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:08.757939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:08.759069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:08.760062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 116/227] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:08.765230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802259-b3ed-460f-8cc9-1a6dcbdca9cb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.823556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054216aa-8544-43f4-8bc0-c20376e0d844 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.856955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dba66-b219-412d-a686-08215a3f0bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.857635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dba66-b219-412d-a686-08215a3f0bae None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.858023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dba66-b219-412d-a686-08215a3f0bae None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.858291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dba66-b219-412d-a686-08215a3f0bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.883365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802259-b3ed-460f-8cc9-1a6dcbdca9cb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.929130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.930248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.930952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.931611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.932531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:08.932833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.934423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.937428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9dba66-b219-412d-a686-08215a3f0bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.939067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9dba66-b219-412d-a686-08215a3f0bae None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.946108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 117/228] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:08.951724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:09.056129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 112/229] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 17:26:09.061732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dba66-b219-412d-a686-08215a3f0bae None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:09.078772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9acaff-72d7-4abc-936d-0deb1fd0c92d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:09.120627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4406-96b5-440b-85ff-39e5c10a57c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:09.121816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4406-96b5-440b-85ff-39e5c10a57c8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:09.122633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4406-96b5-440b-85ff-39e5c10a57c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:09.123047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4406-96b5-440b-85ff-39e5c10a57c8 None admin] PATH_INFO: `/v3/users/4454d45d26394fe196c2c9c2a3e81e52` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:09.124965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac4406-96b5-440b-85ff-39e5c10a57c8 None admin] RBAC: Authorizing `identity:get_user(user_id=4454d45d26394fe196c2c9c2a3e81e52)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:09.126915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac4406-96b5-440b-85ff-39e5c10a57c8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:09.129140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 118/230] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/users/4454d45d26394fe196c2c9c2a3e81e52 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:09.134826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4406-96b5-440b-85ff-39e5c10a57c8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:09.185439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dba66-b219-412d-a686-08215a3f0bae None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:09.228446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a5479-a241-40de-b299-371228f1dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:09.229642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a5479-a241-40de-b299-371228f1dd55 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:09.229929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a5479-a241-40de-b299-371228f1dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:09.230200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a5479-a241-40de-b299-371228f1dd55 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:09.231832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a5479-a241-40de-b299-371228f1dd55 None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:09.233383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a5479-a241-40de-b299-371228f1dd55 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:09.235906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 113/231] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:09 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:09.242023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a5479-a241-40de-b299-371228f1dd55 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:09.259000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4406-96b5-440b-85ff-39e5c10a57c8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:09.342323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684604cf-0338-4b56-b459-61275dc9225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:09.343589 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684604cf-0338-4b56-b459-61275dc9225a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:09.344081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684604cf-0338-4b56-b459-61275dc9225a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:09.344540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684604cf-0338-4b56-b459-61275dc9225a None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:09.348073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a5479-a241-40de-b299-371228f1dd55 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:09.348971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684604cf-0338-4b56-b459-61275dc9225a None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:09.350681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684604cf-0338-4b56-b459-61275dc9225a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:09.352617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 119/232] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:09 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:09.374200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684604cf-0338-4b56-b459-61275dc9225a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:09.388267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7326-c1b3-468d-9d67-4167d812f49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:09.388935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7326-c1b3-468d-9d67-4167d812f49b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:09.389292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7326-c1b3-468d-9d67-4167d812f49b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:09.389595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7326-c1b3-468d-9d67-4167d812f49b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:09.390444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7326-c1b3-468d-9d67-4167d812f49b None admin] RBAC: Adding query filter params (role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=938f6968326342b59e88886f73e95b00, user.id=aba024e85ab84cea9832c232f9bd2610) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:09.390756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7326-c1b3-468d-9d67-4167d812f49b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:09.392208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7326-c1b3-468d-9d67-4167d812f49b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:09.401605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 114/233] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:09 2022] GET /identity/v3/role_assignments?user.id=aba024e85ab84cea9832c232f9bd2610&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=c9deaccdca814832a7d143419fd1d54f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:09.528013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684604cf-0338-4b56-b459-61275dc9225a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:09.565235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944ee6a-8c8a-497b-8a8b-aeeaf13c7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:09.566179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944ee6a-8c8a-497b-8a8b-aeeaf13c7a8c None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:09.566461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944ee6a-8c8a-497b-8a8b-aeeaf13c7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:09.566734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944ee6a-8c8a-497b-8a8b-aeeaf13c7a8c None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00/users/4454d45d26394fe196c2c9c2a3e81e52/roles/b2a32fa865d44fe48cd439137f78a12f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:09.569023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944ee6a-8c8a-497b-8a8b-aeeaf13c7a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=938f6968326342b59e88886f73e95b00, user_id=4454d45d26394fe196c2c9c2a3e81e52, role_id=b2a32fa865d44fe48cd439137f78a12f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:09.570535 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944ee6a-8c8a-497b-8a8b-aeeaf13c7a8c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:09.590868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 120/234] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:09 2022] PUT /identity/v3/projects/938f6968326342b59e88886f73e95b00/users/4454d45d26394fe196c2c9c2a3e81e52/roles/b2a32fa865d44fe48cd439137f78a12f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:11.091970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a0d1-5ec8-44f4-8f32-e1cd254c7467 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.092544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a0d1-5ec8-44f4-8f32-e1cd254c7467 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.092617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a0d1-5ec8-44f4-8f32-e1cd254c7467 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.094015 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 115/235] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:11.099446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a950b0-6eee-4eed-8e9c-4d38b87fd77d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.099864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a950b0-6eee-4eed-8e9c-4d38b87fd77d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.100033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a950b0-6eee-4eed-8e9c-4d38b87fd77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.117184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-46a950b0-6eee-4eed-8e9c-4d38b87fd77d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:11.118436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46a950b0-6eee-4eed-8e9c-4d38b87fd77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:11.188244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 121/236] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:11.211963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0a0d1-5ec8-44f4-8f32-e1cd254c7467 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:11.317702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0a0d1-5ec8-44f4-8f32-e1cd254c7467 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:11.352657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f3e4-62ba-45d7-8f6a-9db3775949e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:11.353381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f3e4-62ba-45d7-8f6a-9db3775949e0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.353688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f3e4-62ba-45d7-8f6a-9db3775949e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.353958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f3e4-62ba-45d7-8f6a-9db3775949e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.364629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937f3e4-62ba-45d7-8f6a-9db3775949e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8937f3e4-62ba-45d7-8f6a-9db3775949e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:11.372385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:11.373324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:11.374160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 116/237] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:11.379685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a950b0-6eee-4eed-8e9c-4d38b87fd77d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:11.482933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a950b0-6eee-4eed-8e9c-4d38b87fd77d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:11.523434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bab5f-a92b-4096-af4b-37b0fb1a412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:11.524109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bab5f-a92b-4096-af4b-37b0fb1a412b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.524391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bab5f-a92b-4096-af4b-37b0fb1a412b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.524669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bab5f-a92b-4096-af4b-37b0fb1a412b None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.525423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bab5f-a92b-4096-af4b-37b0fb1a412b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:11.525758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bab5f-a92b-4096-af4b-37b0fb1a412b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:11.527146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bab5f-a92b-4096-af4b-37b0fb1a412b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:11.539409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 122/238] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:11.542182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f3e4-62ba-45d7-8f6a-9db3775949e0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:11.593104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f686a-9289-4beb-a703-e0d6fc46e592 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.593453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f686a-9289-4beb-a703-e0d6fc46e592 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.593698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f686a-9289-4beb-a703-e0d6fc46e592 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.595057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 123/239] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:11.600047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da2ed-2741-4ad8-b83a-7051c50dd461 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.600326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da2ed-2741-4ad8-b83a-7051c50dd461 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.600598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da2ed-2741-4ad8-b83a-7051c50dd461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.622609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-962da2ed-2741-4ad8-b83a-7051c50dd461 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:11.623741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-962da2ed-2741-4ad8-b83a-7051c50dd461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:11.676080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f3e4-62ba-45d7-8f6a-9db3775949e0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:11.704140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 124/240] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:11.705633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812eab-10ea-47eb-bc95-63f99fec359e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.705923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812eab-10ea-47eb-bc95-63f99fec359e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.706189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812eab-10ea-47eb-bc95-63f99fec359e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.707716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 125/241] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:11.709376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911c615-863c-477d-8fa0-469934f2c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:11.710319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911c615-863c-477d-8fa0-469934f2c20e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.710598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911c615-863c-477d-8fa0-469934f2c20e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.710872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911c615-863c-477d-8fa0-469934f2c20e None admin] PATH_INFO: `/v3/users/4454d45d26394fe196c2c9c2a3e81e52` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.712215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911c615-863c-477d-8fa0-469934f2c20e None admin] RBAC: Authorizing `identity:get_user(user_id=4454d45d26394fe196c2c9c2a3e81e52)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:11.713262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02319cfe-8dfb-4929-8aae-74f7d0ded6e5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.713562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02319cfe-8dfb-4929-8aae-74f7d0ded6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.713743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911c615-863c-477d-8fa0-469934f2c20e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:11.713840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02319cfe-8dfb-4929-8aae-74f7d0ded6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.715901 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 117/242] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:11 2022] GET /identity/v3/users/4454d45d26394fe196c2c9c2a3e81e52 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:11.722004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911c615-863c-477d-8fa0-469934f2c20e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:11.736512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-02319cfe-8dfb-4929-8aae-74f7d0ded6e5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:11.737802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-02319cfe-8dfb-4929-8aae-74f7d0ded6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:11.806709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 126/243] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:11.807609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02319cfe-8dfb-4929-8aae-74f7d0ded6e5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:11.859404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911c615-863c-477d-8fa0-469934f2c20e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:11.899870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c67798-f896-4d5c-9917-a9fbe5617065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:11.900750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c67798-f896-4d5c-9917-a9fbe5617065 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.901031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c67798-f896-4d5c-9917-a9fbe5617065 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.901577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c67798-f896-4d5c-9917-a9fbe5617065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.921851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02319cfe-8dfb-4929-8aae-74f7d0ded6e5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:11.956436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e0fd0-dcd8-4e22-808b-25e2f4149402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:11.957408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e0fd0-dcd8-4e22-808b-25e2f4149402 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:11.957798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e0fd0-dcd8-4e22-808b-25e2f4149402 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:11.958145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e0fd0-dcd8-4e22-808b-25e2f4149402 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:11.959429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e0fd0-dcd8-4e22-808b-25e2f4149402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:11.960995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e0fd0-dcd8-4e22-808b-25e2f4149402 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:11.963086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 127/244] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:11.964049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e0fd0-dcd8-4e22-808b-25e2f4149402 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:11.981276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c67798-f896-4d5c-9917-a9fbe5617065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:11.983270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c67798-f896-4d5c-9917-a9fbe5617065 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.060789 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e0fd0-dcd8-4e22-808b-25e2f4149402 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.084383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 118/245] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 17:26:12.088941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c67798-f896-4d5c-9917-a9fbe5617065 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.099017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf677a3-8c71-49ab-8ce2-3eb302645e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.099816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf677a3-8c71-49ab-8ce2-3eb302645e18 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.100337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf677a3-8c71-49ab-8ce2-3eb302645e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.100337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf677a3-8c71-49ab-8ce2-3eb302645e18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.110383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf677a3-8c71-49ab-8ce2-3eb302645e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cbf677a3-8c71-49ab-8ce2-3eb302645e18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:12.117996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:12.119029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:12.120009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 128/246] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:12.120818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2e65d-696f-4a2b-b3c2-a67acfdc3a41 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.120818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2e65d-696f-4a2b-b3c2-a67acfdc3a41 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.120962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2e65d-696f-4a2b-b3c2-a67acfdc3a41 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.126714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 129/247] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:12.127571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2e65d-696f-4a2b-b3c2-a67acfdc3a41 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.185604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c67798-f896-4d5c-9917-a9fbe5617065 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.217765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761403d-725b-436d-bc4d-0008155e91d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.218445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761403d-725b-436d-bc4d-0008155e91d3 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.218723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761403d-725b-436d-bc4d-0008155e91d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.218992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761403d-725b-436d-bc4d-0008155e91d3 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.219697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761403d-725b-436d-bc4d-0008155e91d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:12.221138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761403d-725b-436d-bc4d-0008155e91d3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.234661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2e65d-696f-4a2b-b3c2-a67acfdc3a41 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.241632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 119/248] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:12 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:12.242431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761403d-725b-436d-bc4d-0008155e91d3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.281635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4595c-81a1-4765-9653-078160cb54ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.282703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4595c-81a1-4765-9653-078160cb54ea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.283903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4595c-81a1-4765-9653-078160cb54ea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.284226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4595c-81a1-4765-9653-078160cb54ea None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.285532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4595c-81a1-4765-9653-078160cb54ea None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:12.287034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4595c-81a1-4765-9653-078160cb54ea None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.289658 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 130/249] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:12 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:12.295082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561ded-079d-4093-9a58-3d77b7234675 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.295483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561ded-079d-4093-9a58-3d77b7234675 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.295695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561ded-079d-4093-9a58-3d77b7234675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.319209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-14561ded-079d-4093-9a58-3d77b7234675 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:12.321066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-14561ded-079d-4093-9a58-3d77b7234675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:12.379126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761403d-725b-436d-bc4d-0008155e91d3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.396780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 131/250] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:12.398074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14561ded-079d-4093-9a58-3d77b7234675 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.438351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.439268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.439553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.439878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.440641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:12.441142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:12.442951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.451767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 120/251] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:12.452630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.530260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14561ded-079d-4093-9a58-3d77b7234675 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.576585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da60b7-2e43-4b6c-9680-c5b1d765f43b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.578729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.579399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.579671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.580784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.581676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=938f6968326342b59e88886f73e95b00, user.id=4454d45d26394fe196c2c9c2a3e81e52) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:12.581987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:12.583430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.590651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 132/252] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:12 2022] GET /identity/v3/role_assignments?user.id=4454d45d26394fe196c2c9c2a3e81e52&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:12.591592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.624773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccf2ad-5cfa-4027-aba0-96b8074dc003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.626198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf2ad-5cfa-4027-aba0-96b8074dc003 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.626650 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf2ad-5cfa-4027-aba0-96b8074dc003 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.627235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf2ad-5cfa-4027-aba0-96b8074dc003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.651863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccf2ad-5cfa-4027-aba0-96b8074dc003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a7ccf2ad-5cfa-4027-aba0-96b8074dc003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:12.662303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:12.663279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:12.664080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 121/253] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:12.665603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4309b-3ba8-4d76-8e23-31680e5d2e3b None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.665991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4309b-3ba8-4d76-8e23-31680e5d2e3b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.666343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4309b-3ba8-4d76-8e23-31680e5d2e3b None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.667839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 122/254] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:12.673982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4fe3-ae18-47c5-804a-ff01bdc56717 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.674370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4fe3-ae18-47c5-804a-ff01bdc56717 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.674763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4fe3-ae18-47c5-804a-ff01bdc56717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.694582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-90fe4fe3-ae18-47c5-804a-ff01bdc56717 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:12.695980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-90fe4fe3-ae18-47c5-804a-ff01bdc56717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:12.727061 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d034eb-84d0-44d8-8c26-365ee228e2d7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.790731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c8f4-4d9d-44cb-893a-f6734f1ef0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.791921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c8f4-4d9d-44cb-893a-f6734f1ef0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.792357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c8f4-4d9d-44cb-893a-f6734f1ef0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.792804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c8f4-4d9d-44cb-893a-f6734f1ef0c9 None admin] PATH_INFO: `/v3/users/a1e6480734e948d890e9fe6061dd9f19` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.813337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 123/255] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:12.814522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4fe3-ae18-47c5-804a-ff01bdc56717 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.815510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69c8f4-4d9d-44cb-893a-f6734f1ef0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=a1e6480734e948d890e9fe6061dd9f19)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:12.817097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69c8f4-4d9d-44cb-893a-f6734f1ef0c9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.819316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 133/256] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:12 2022] GET /identity/v3/users/a1e6480734e948d890e9fe6061dd9f19 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:12.824628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c8f4-4d9d-44cb-893a-f6734f1ef0c9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.917055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4fe3-ae18-47c5-804a-ff01bdc56717 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.927528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c8f4-4d9d-44cb-893a-f6734f1ef0c9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.953614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.955113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.955562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.956140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.957484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:12.958059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:12.959579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.961452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4fb7f-b460-4aad-a0d3-480a0ce94771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.962363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4fb7f-b460-4aad-a0d3-480a0ce94771 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.962529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4fb7f-b460-4aad-a0d3-480a0ce94771 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.963952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4fb7f-b460-4aad-a0d3-480a0ce94771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.970381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 124/257] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:12.971451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.050762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4fb7f-b460-4aad-a0d3-480a0ce94771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.054050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4fb7f-b460-4aad-a0d3-480a0ce94771 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.080666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3062bee-5e3a-4368-a13d-7937d51359d5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.116058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e33653-a8a5-4cad-a348-eded844e8b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.116967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e33653-a8a5-4cad-a348-eded844e8b13 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.117312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e33653-a8a5-4cad-a348-eded844e8b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.117692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e33653-a8a5-4cad-a348-eded844e8b13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.128114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e33653-a8a5-4cad-a348-eded844e8b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-41e33653-a8a5-4cad-a348-eded844e8b13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:13.136427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:13.137500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:13.138304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:13.138886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 125/258] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:13.140148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e33653-a8a5-4cad-a348-eded844e8b13 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.169197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 134/259] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:13.170711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4fb7f-b460-4aad-a0d3-480a0ce94771 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.251952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e33653-a8a5-4cad-a348-eded844e8b13 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.267694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4fb7f-b460-4aad-a0d3-480a0ce94771 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.285149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347196b-1a0c-419d-85af-9f879ed94e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.286182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347196b-1a0c-419d-85af-9f879ed94e43 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.286526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347196b-1a0c-419d-85af-9f879ed94e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.286861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347196b-1a0c-419d-85af-9f879ed94e43 None admin] PATH_INFO: `/v3/users/aba024e85ab84cea9832c232f9bd2610` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.288132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347196b-1a0c-419d-85af-9f879ed94e43 None admin] RBAC: Authorizing `identity:get_user(user_id=aba024e85ab84cea9832c232f9bd2610)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.289688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347196b-1a0c-419d-85af-9f879ed94e43 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.295944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 126/260] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/users/aba024e85ab84cea9832c232f9bd2610 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:13.295944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347196b-1a0c-419d-85af-9f879ed94e43 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.308622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.309989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.310728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.311268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.312375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:13.313094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.314705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.326703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 135/261] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:13.327876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.402738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347196b-1a0c-419d-85af-9f879ed94e43 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.436059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca84c7d-830f-4eaf-9737-60bd3f4deae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.437808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca84c7d-830f-4eaf-9737-60bd3f4deae7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.438371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca84c7d-830f-4eaf-9737-60bd3f4deae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.439323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca84c7d-830f-4eaf-9737-60bd3f4deae7 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.441386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca84c7d-830f-4eaf-9737-60bd3f4deae7 None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.444956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca84c7d-830f-4eaf-9737-60bd3f4deae7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.447840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 127/262] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:13.450322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca84c7d-830f-4eaf-9737-60bd3f4deae7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.461673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa19fc2-0561-485b-a005-2581c7cd960e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.493270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a6ff-2b7d-4709-a792-25c5e3aaccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.494447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a6ff-2b7d-4709-a792-25c5e3aaccdc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.494915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a6ff-2b7d-4709-a792-25c5e3aaccdc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.495391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a6ff-2b7d-4709-a792-25c5e3aaccdc None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.496737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a6ff-2b7d-4709-a792-25c5e3aaccdc None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.498514 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a6ff-2b7d-4709-a792-25c5e3aaccdc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.500453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 136/263] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:13.506058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a6ff-2b7d-4709-a792-25c5e3aaccdc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.567012 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca84c7d-830f-4eaf-9737-60bd3f4deae7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.609674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3345936-3aa9-4b46-bf7e-fb11e9d587ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.610844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345936-3aa9-4b46-bf7e-fb11e9d587ed None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.611125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345936-3aa9-4b46-bf7e-fb11e9d587ed None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.611398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345936-3aa9-4b46-bf7e-fb11e9d587ed None admin] PATH_INFO: `/v3/users/4454d45d26394fe196c2c9c2a3e81e52` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.612592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3345936-3aa9-4b46-bf7e-fb11e9d587ed None admin] RBAC: Authorizing `identity:get_user(user_id=4454d45d26394fe196c2c9c2a3e81e52)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.614486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3345936-3aa9-4b46-bf7e-fb11e9d587ed None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.616816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 128/264] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/users/4454d45d26394fe196c2c9c2a3e81e52 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:13.620915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3345936-3aa9-4b46-bf7e-fb11e9d587ed None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.631069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a6ff-2b7d-4709-a792-25c5e3aaccdc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.672456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.673516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.673957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.674623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.675615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] RBAC: Adding query filter params (role.id=fb8aa50542444837855b787315bea7a9, scope.project.id=938f6968326342b59e88886f73e95b00, user.id=a1e6480734e948d890e9fe6061dd9f19) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:13.676061 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.678530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.686399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 137/265] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/role_assignments?user.id=a1e6480734e948d890e9fe6061dd9f19&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=fb8aa50542444837855b787315bea7a9 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:13.687422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.794926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3345936-3aa9-4b46-bf7e-fb11e9d587ed None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.850961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fea4c-8830-4141-98db-1cf60ff5ccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.852224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fea4c-8830-4141-98db-1cf60ff5ccab None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.852693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fea4c-8830-4141-98db-1cf60ff5ccab None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.853150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fea4c-8830-4141-98db-1cf60ff5ccab None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00/users/aba024e85ab84cea9832c232f9bd2610/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.855374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fea4c-8830-4141-98db-1cf60ff5ccab None admin] RBAC: Authorizing `identity:create_grant(project_id=938f6968326342b59e88886f73e95b00, user_id=aba024e85ab84cea9832c232f9bd2610, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.857082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fea4c-8830-4141-98db-1cf60ff5ccab None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.861348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a9a37-7603-4287-ab28-a5d4edcfbaf0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.874284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 129/266] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:13 2022] PUT /identity/v3/projects/938f6968326342b59e88886f73e95b00/users/aba024e85ab84cea9832c232f9bd2610/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:13.916597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef32c5c-c386-432e-babe-dd75ac7561a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.917281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32c5c-c386-432e-babe-dd75ac7561a8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.917596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32c5c-c386-432e-babe-dd75ac7561a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.917857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32c5c-c386-432e-babe-dd75ac7561a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.993430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef32c5c-c386-432e-babe-dd75ac7561a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.995081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef32c5c-c386-432e-babe-dd75ac7561a8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.104751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 138/267] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:14.110258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fea4c-8830-4141-98db-1cf60ff5ccab None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.225972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fea4c-8830-4141-98db-1cf60ff5ccab None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:14.258876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf7510-69af-4536-adae-15fdcbc859e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:14.259737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7510-69af-4536-adae-15fdcbc859e1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.260012 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7510-69af-4536-adae-15fdcbc859e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.260285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7510-69af-4536-adae-15fdcbc859e1 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.261455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf7510-69af-4536-adae-15fdcbc859e1 None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:14.262923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf7510-69af-4536-adae-15fdcbc859e1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.265058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 130/268] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:14 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:14.270743 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef32c5c-c386-432e-babe-dd75ac7561a8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.429565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef32c5c-c386-432e-babe-dd75ac7561a8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:14.477191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98502b-8984-4de9-b596-41b4b6245695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:14.477884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98502b-8984-4de9-b596-41b4b6245695 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.478163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98502b-8984-4de9-b596-41b4b6245695 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.478433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98502b-8984-4de9-b596-41b4b6245695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.479268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98502b-8984-4de9-b596-41b4b6245695 None admin] RBAC: Adding query filter params (role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=938f6968326342b59e88886f73e95b00, user.id=4454d45d26394fe196c2c9c2a3e81e52) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:14.479580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98502b-8984-4de9-b596-41b4b6245695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:14.481024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98502b-8984-4de9-b596-41b4b6245695 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.490340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 139/269] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:14 2022] GET /identity/v3/role_assignments?user.id=4454d45d26394fe196c2c9c2a3e81e52&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:14.822263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a4da-c346-4039-8746-37b915a96f3b None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.822633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a4da-c346-4039-8746-37b915a96f3b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.822795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a4da-c346-4039-8746-37b915a96f3b None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.824506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 131/270] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:14.829732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17eb6-e8ee-4c85-b0eb-d68a32b5fa8a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.830019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17eb6-e8ee-4c85-b0eb-d68a32b5fa8a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.830295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17eb6-e8ee-4c85-b0eb-d68a32b5fa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.849154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6cb17eb6-e8ee-4c85-b0eb-d68a32b5fa8a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:14.850358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6cb17eb6-e8ee-4c85-b0eb-d68a32b5fa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:14.932081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 140/271] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:14.933608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e652f-addc-4e08-bcf6-c4119c38f6e6 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.934024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e652f-addc-4e08-bcf6-c4119c38f6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.934493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e652f-addc-4e08-bcf6-c4119c38f6e6 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.936106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 132/272] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:14.948265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b3ff-5fdf-409e-b7f8-89e02ffff761 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.948898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b3ff-5fdf-409e-b7f8-89e02ffff761 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.949365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b3ff-5fdf-409e-b7f8-89e02ffff761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.954543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e652f-addc-4e08-bcf6-c4119c38f6e6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.969492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e380b3ff-5fdf-409e-b7f8-89e02ffff761 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:14.970697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e380b3ff-5fdf-409e-b7f8-89e02ffff761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:15.045649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 141/273] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:15.073433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380b3ff-5fdf-409e-b7f8-89e02ffff761 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:15.080064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e652f-addc-4e08-bcf6-c4119c38f6e6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:15.117494 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509d10-eeba-47fc-98aa-da9ab337bb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:15.118661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509d10-eeba-47fc-98aa-da9ab337bb10 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:15.118947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509d10-eeba-47fc-98aa-da9ab337bb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:15.119217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509d10-eeba-47fc-98aa-da9ab337bb10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:15.131509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509d10-eeba-47fc-98aa-da9ab337bb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ed509d10-eeba-47fc-98aa-da9ab337bb10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:15.141727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:15.142610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:15.143392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:15.144031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 133/274] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:15.154685 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509d10-eeba-47fc-98aa-da9ab337bb10 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:15.173346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380b3ff-5fdf-409e-b7f8-89e02ffff761 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:15.208467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd83fb-ffc6-4df2-91b3-af77a833e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:15.209260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd83fb-ffc6-4df2-91b3-af77a833e2ef None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:15.209533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd83fb-ffc6-4df2-91b3-af77a833e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:15.209827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd83fb-ffc6-4df2-91b3-af77a833e2ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:15.210974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd83fb-ffc6-4df2-91b3-af77a833e2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:15.212418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd83fb-ffc6-4df2-91b3-af77a833e2ef None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:15.214365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 142/275] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:15.219653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd83fb-ffc6-4df2-91b3-af77a833e2ef None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:15.283963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509d10-eeba-47fc-98aa-da9ab337bb10 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:15.322045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:15.322288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd83fb-ffc6-4df2-91b3-af77a833e2ef None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:15.322716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:15.322994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:15.323266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:15.324089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:15.324333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:15.325848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:15.335653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 134/276] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:15.340935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:15.362928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5881a-0de4-4380-a186-8b4f2951c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:15.363863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5881a-0de4-4380-a186-8b4f2951c9e1 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:15.364138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5881a-0de4-4380-a186-8b4f2951c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:15.364409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5881a-0de4-4380-a186-8b4f2951c9e1 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:15.365593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5881a-0de4-4380-a186-8b4f2951c9e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:15.367435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5881a-0de4-4380-a186-8b4f2951c9e1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:15.392172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 143/277] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:15 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:26:15.450602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7d75c-4ca5-4083-ab30-098ebd77f6d7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:15.488313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5a79-0840-4e31-93a2-58c821faa4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:15.489207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5a79-0840-4e31-93a2-58c821faa4fe None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:15.489483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5a79-0840-4e31-93a2-58c821faa4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:15.489782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5a79-0840-4e31-93a2-58c821faa4fe None admin] PATH_INFO: `/v3/users/e089fd7ee1fd45e28c3ba762ac7831e1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:15.505164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5a79-0840-4e31-93a2-58c821faa4fe None admin] RBAC: Authorizing `identity:get_user(user_id=e089fd7ee1fd45e28c3ba762ac7831e1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:15.506679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5a79-0840-4e31-93a2-58c821faa4fe None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:15.508860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 135/278] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:15 2022] GET /identity/v3/users/e089fd7ee1fd45e28c3ba762ac7831e1 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:15.514746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5881a-0de4-4380-a186-8b4f2951c9e1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:15.615511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5881a-0de4-4380-a186-8b4f2951c9e1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:15.647174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea11799-ffd2-49d8-8ae8-b25ae0389ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:15.647827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11799-ffd2-49d8-8ae8-b25ae0389ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:15.648099 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11799-ffd2-49d8-8ae8-b25ae0389ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:15.648368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11799-ffd2-49d8-8ae8-b25ae0389ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:15.649185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11799-ffd2-49d8-8ae8-b25ae0389ee4 None admin] RBAC: Adding query filter params (role.id=c9deaccdca814832a7d143419fd1d54f, user.id=e089fd7ee1fd45e28c3ba762ac7831e1, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:15.649488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11799-ffd2-49d8-8ae8-b25ae0389ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:15.650957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11799-ffd2-49d8-8ae8-b25ae0389ee4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:15.656610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 144/279] 10.222.0.58 () {56 vars in 1308 bytes} [Mon May 16 17:26:15 2022] GET /identity/v3/role_assignments?user.id=e089fd7ee1fd45e28c3ba762ac7831e1&scope.system=all&role.id=c9deaccdca814832a7d143419fd1d54f => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:16.396289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922214bd-9849-4112-8cf6-05916aa6a99c None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:16.396872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922214bd-9849-4112-8cf6-05916aa6a99c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:16.396872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922214bd-9849-4112-8cf6-05916aa6a99c None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:16.398773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 136/280] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:16.404258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c295-e165-4667-aed5-96b96f25e1f8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:16.405206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c295-e165-4667-aed5-96b96f25e1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:16.405704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c295-e165-4667-aed5-96b96f25e1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:16.430516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5278c295-e165-4667-aed5-96b96f25e1f8 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:16.432032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5278c295-e165-4667-aed5-96b96f25e1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:16.518751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 145/281] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:16.518969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec119c-2290-48f3-8773-481fbe8301b7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:16.519200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec119c-2290-48f3-8773-481fbe8301b7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:16.519614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec119c-2290-48f3-8773-481fbe8301b7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:16.521300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 137/282] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:16.526587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ffb88-5cc4-4fa8-89e7-6ac6d827fbf0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:16.527041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ffb88-5cc4-4fa8-89e7-6ac6d827fbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:16.527445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ffb88-5cc4-4fa8-89e7-6ac6d827fbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:16.543021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec119c-2290-48f3-8773-481fbe8301b7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:16.559368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0c0ffb88-5cc4-4fa8-89e7-6ac6d827fbf0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:16.560529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0c0ffb88-5cc4-4fa8-89e7-6ac6d827fbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:16.646087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec119c-2290-48f3-8773-481fbe8301b7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:16.666864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 146/283] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:16.680626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94559291-ad22-47f9-98c7-789a6c135670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:16.681825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94559291-ad22-47f9-98c7-789a6c135670 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:16.682296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94559291-ad22-47f9-98c7-789a6c135670 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:16.682777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94559291-ad22-47f9-98c7-789a6c135670 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:16.695163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94559291-ad22-47f9-98c7-789a6c135670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-94559291-ad22-47f9-98c7-789a6c135670 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:16.703682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:16.704594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:16.705380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:16.708137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 138/284] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:16.713102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ffb88-5cc4-4fa8-89e7-6ac6d827fbf0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:16.714201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94559291-ad22-47f9-98c7-789a6c135670 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:16.813444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94559291-ad22-47f9-98c7-789a6c135670 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:16.846613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:16.847649 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:16.848132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:16.848590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:16.849534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:16.850070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:16.851624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:16.860679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 139/285] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:16.868025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:16.975665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ffb88-5cc4-4fa8-89e7-6ac6d827fbf0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:16.979353 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1ffa-fc2b-4377-84f4-5ed75fc3f9c5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.014908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d160-4c00-4d71-9756-ba27e0b35dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.016245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d160-4c00-4d71-9756-ba27e0b35dbd None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.016715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d160-4c00-4d71-9756-ba27e0b35dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.017198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d160-4c00-4d71-9756-ba27e0b35dbd None admin] PATH_INFO: `/v3/users/a1e6480734e948d890e9fe6061dd9f19` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.018743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6d160-4c00-4d71-9756-ba27e0b35dbd None admin] RBAC: Authorizing `identity:get_user(user_id=a1e6480734e948d890e9fe6061dd9f19)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.020530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6d160-4c00-4d71-9756-ba27e0b35dbd None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.023044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 140/286] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:16 2022] GET /identity/v3/users/a1e6480734e948d890e9fe6061dd9f19 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:17.038520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d160-4c00-4d71-9756-ba27e0b35dbd None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.058274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9178b5d-1808-4b6f-9f06-e768b5f484f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.059058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9178b5d-1808-4b6f-9f06-e768b5f484f1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.059330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9178b5d-1808-4b6f-9f06-e768b5f484f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.059595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9178b5d-1808-4b6f-9f06-e768b5f484f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.090555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9178b5d-1808-4b6f-9f06-e768b5f484f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b9178b5d-1808-4b6f-9f06-e768b5f484f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:17.102656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:17.103670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:17.104459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 147/287] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:17.109734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9178b5d-1808-4b6f-9f06-e768b5f484f1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.150797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d160-4c00-4d71-9756-ba27e0b35dbd None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.200130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a494d-d1b7-4612-b661-5eebc97c0cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.206850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a494d-d1b7-4612-b661-5eebc97c0cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.207397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a494d-d1b7-4612-b661-5eebc97c0cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.207882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a494d-d1b7-4612-b661-5eebc97c0cc1 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.213675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a494d-d1b7-4612-b661-5eebc97c0cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.215372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a494d-d1b7-4612-b661-5eebc97c0cc1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.217802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 141/288] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:17 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:17.231568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a494d-d1b7-4612-b661-5eebc97c0cc1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.236060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9178b5d-1808-4b6f-9f06-e768b5f484f1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.275131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.275803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.276081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.276354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.277104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:17.277409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.278807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.291321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 148/289] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:17.294498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.384942 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a494d-d1b7-4612-b661-5eebc97c0cc1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.444136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ef8f6-f927-4c86-b777-62bde90d1808 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.472037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ebf97-a350-4de9-b55f-c38224a43091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.472971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ebf97-a350-4de9-b55f-c38224a43091 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.473235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ebf97-a350-4de9-b55f-c38224a43091 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.473498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ebf97-a350-4de9-b55f-c38224a43091 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00/users/a1e6480734e948d890e9fe6061dd9f19/roles/fb8aa50542444837855b787315bea7a9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.478890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ebf97-a350-4de9-b55f-c38224a43091 None admin] RBAC: Authorizing `identity:create_grant(project_id=938f6968326342b59e88886f73e95b00, user_id=a1e6480734e948d890e9fe6061dd9f19, role_id=fb8aa50542444837855b787315bea7a9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.480360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ebf97-a350-4de9-b55f-c38224a43091 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.487468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec15a6-2a18-42f8-9a3e-759751d55c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.488516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec15a6-2a18-42f8-9a3e-759751d55c20 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.488799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec15a6-2a18-42f8-9a3e-759751d55c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.489172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec15a6-2a18-42f8-9a3e-759751d55c20 None admin] PATH_INFO: `/v3/users/aba024e85ab84cea9832c232f9bd2610` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.490793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec15a6-2a18-42f8-9a3e-759751d55c20 None admin] RBAC: Authorizing `identity:get_user(user_id=aba024e85ab84cea9832c232f9bd2610)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.493754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec15a6-2a18-42f8-9a3e-759751d55c20 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.495772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 149/290] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:17 2022] GET /identity/v3/users/aba024e85ab84cea9832c232f9bd2610 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:17.502615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 142/291] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:17 2022] PUT /identity/v3/projects/938f6968326342b59e88886f73e95b00/users/a1e6480734e948d890e9fe6061dd9f19/roles/fb8aa50542444837855b787315bea7a9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:17.503303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec15a6-2a18-42f8-9a3e-759751d55c20 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.606819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec15a6-2a18-42f8-9a3e-759751d55c20 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.648936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd15d4a-919e-4022-9719-26ea2c73945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.649515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd15d4a-919e-4022-9719-26ea2c73945f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.649817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd15d4a-919e-4022-9719-26ea2c73945f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.650088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd15d4a-919e-4022-9719-26ea2c73945f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.742546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd15d4a-919e-4022-9719-26ea2c73945f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.744609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd15d4a-919e-4022-9719-26ea2c73945f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.852947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 150/292] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:17.858528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ebf97-a350-4de9-b55f-c38224a43091 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.968641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ebf97-a350-4de9-b55f-c38224a43091 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.015059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b602a-3c02-44cf-aece-1d36f8b639fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.015952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b602a-3c02-44cf-aece-1d36f8b639fe None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.016225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b602a-3c02-44cf-aece-1d36f8b639fe None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.016492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b602a-3c02-44cf-aece-1d36f8b639fe None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.017843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b602a-3c02-44cf-aece-1d36f8b639fe None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.019327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b602a-3c02-44cf-aece-1d36f8b639fe None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.021209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 143/293] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:17 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:18.027218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd15d4a-919e-4022-9719-26ea2c73945f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.129431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd15d4a-919e-4022-9719-26ea2c73945f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.162622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1021a-f10f-45d9-bc23-ca05cb41b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.163283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1021a-f10f-45d9-bc23-ca05cb41b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.163557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1021a-f10f-45d9-bc23-ca05cb41b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.163826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1021a-f10f-45d9-bc23-ca05cb41b0d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.164650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1021a-f10f-45d9-bc23-ca05cb41b0d7 None admin] RBAC: Adding query filter params (role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=938f6968326342b59e88886f73e95b00, user.id=aba024e85ab84cea9832c232f9bd2610) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:18.164955 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1021a-f10f-45d9-bc23-ca05cb41b0d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.166410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1021a-f10f-45d9-bc23-ca05cb41b0d7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.172893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 151/294] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/role_assignments?user.id=aba024e85ab84cea9832c232f9bd2610&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=c9deaccdca814832a7d143419fd1d54f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:18.269268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106107-c7d4-4389-a15d-1336ea1146f4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.269628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106107-c7d4-4389-a15d-1336ea1146f4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.269872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106107-c7d4-4389-a15d-1336ea1146f4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.271274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 144/295] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:18.277161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d50b5-04ba-44f0-9faf-53f57adb0f63 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.277447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d50b5-04ba-44f0-9faf-53f57adb0f63 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.277744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d50b5-04ba-44f0-9faf-53f57adb0f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.298586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-eb2d50b5-04ba-44f0-9faf-53f57adb0f63 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:18.299757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eb2d50b5-04ba-44f0-9faf-53f57adb0f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:18.369604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 152/296] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:18.404648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106107-c7d4-4389-a15d-1336ea1146f4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.431834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b34d0-e78d-4967-9080-5e0d733b05df None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.432456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b34d0-e78d-4967-9080-5e0d733b05df None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.432953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b34d0-e78d-4967-9080-5e0d733b05df None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.434858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 153/297] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:18.440599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a609-4d13-4c88-a377-6d90e5c9b9b7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.441173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a609-4d13-4c88-a377-6d90e5c9b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.441455 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a609-4d13-4c88-a377-6d90e5c9b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.462650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ae0a609-4d13-4c88-a377-6d90e5c9b9b7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:18.463286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ae0a609-4d13-4c88-a377-6d90e5c9b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:18.527816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106107-c7d4-4389-a15d-1336ea1146f4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.538600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 154/298] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:18.539946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dddef-1fc0-40af-98a1-b5ee37e423b4 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.540232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dddef-1fc0-40af-98a1-b5ee37e423b4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.540692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dddef-1fc0-40af-98a1-b5ee37e423b4 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.545574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 155/299] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:18.547870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b22a-11af-4b2a-9803-8046d1193b81 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.548367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b22a-11af-4b2a-9803-8046d1193b81 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.548779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b22a-11af-4b2a-9803-8046d1193b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.569983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3ed5b22a-11af-4b2a-9803-8046d1193b81 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:18.570944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25761096-77a3-4837-8b98-e4c41b728125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.571548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3ed5b22a-11af-4b2a-9803-8046d1193b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:18.571746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761096-77a3-4837-8b98-e4c41b728125 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.572028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761096-77a3-4837-8b98-e4c41b728125 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.572298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761096-77a3-4837-8b98-e4c41b728125 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.583861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25761096-77a3-4837-8b98-e4c41b728125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-25761096-77a3-4837-8b98-e4c41b728125 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:18.591638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:18.592821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:18.593822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 145/300] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:18.594697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25761096-77a3-4837-8b98-e4c41b728125 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.645320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 156/301] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:18.646201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5b22a-11af-4b2a-9803-8046d1193b81 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.700003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25761096-77a3-4837-8b98-e4c41b728125 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.731612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83a446-1082-4696-b2c5-f1b06bbfd242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.732405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83a446-1082-4696-b2c5-f1b06bbfd242 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.732717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83a446-1082-4696-b2c5-f1b06bbfd242 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.732995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83a446-1082-4696-b2c5-f1b06bbfd242 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.742818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83a446-1082-4696-b2c5-f1b06bbfd242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:18.745214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5b22a-11af-4b2a-9803-8046d1193b81 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-af83a446-1082-4696-b2c5-f1b06bbfd242 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:18.750555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:18.751416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 146/302] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:18.753208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83a446-1082-4696-b2c5-f1b06bbfd242 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.789939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.790529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.790807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.791077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.791822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:18.792123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.793493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.807799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 157/303] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:18.808663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.856062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83a446-1082-4696-b2c5-f1b06bbfd242 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.887257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3d7e0-706b-4012-a8be-63ee7a2f4281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.888043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d7e0-706b-4012-a8be-63ee7a2f4281 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.888319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d7e0-706b-4012-a8be-63ee7a2f4281 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.888586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d7e0-706b-4012-a8be-63ee7a2f4281 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.889828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3d7e0-706b-4012-a8be-63ee7a2f4281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.891291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3d7e0-706b-4012-a8be-63ee7a2f4281 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.892896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 147/304] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:18.893660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3d7e0-706b-4012-a8be-63ee7a2f4281 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.909753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb73eaa-3e75-4b2f-bd4e-b98ee2e51abe None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.945021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.945711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.945987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.946260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.946990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:18.947289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.948646 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.961062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 158/305] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:18.961062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.994429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3d7e0-706b-4012-a8be-63ee7a2f4281 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:19.027408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539f621-0660-44e2-8ced-2d1e8050dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:19.028280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539f621-0660-44e2-8ced-2d1e8050dbaa None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:19.028556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539f621-0660-44e2-8ced-2d1e8050dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:19.028825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539f621-0660-44e2-8ced-2d1e8050dbaa None admin] PATH_INFO: `/v3/users/d67cd152934c490984a239a7d711b72a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:19.042189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539f621-0660-44e2-8ced-2d1e8050dbaa None admin] RBAC: Authorizing `identity:get_user(user_id=d67cd152934c490984a239a7d711b72a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:19.043624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539f621-0660-44e2-8ced-2d1e8050dbaa None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:19.045463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 148/306] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/users/d67cd152934c490984a239a7d711b72a => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:19.051215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539f621-0660-44e2-8ced-2d1e8050dbaa None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:19.055015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac1517-8831-4e03-9b57-c5f29f1dda5b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:19.088346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95770c-3d5a-4d09-8874-cf8f33cb804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:19.089015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95770c-3d5a-4d09-8874-cf8f33cb804a None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:19.089295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95770c-3d5a-4d09-8874-cf8f33cb804a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:19.089579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95770c-3d5a-4d09-8874-cf8f33cb804a None admin] PATH_INFO: `/v3/groups` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:19.090280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95770c-3d5a-4d09-8874-cf8f33cb804a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:19.091707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95770c-3d5a-4d09-8874-cf8f33cb804a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:19.109674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 159/307] 10.222.0.58 () {60 vars in 1134 bytes} [Mon May 16 17:26:18 2022] POST /identity/v3/groups => generated 229 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:19.109674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95770c-3d5a-4d09-8874-cf8f33cb804a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:19.159673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539f621-0660-44e2-8ced-2d1e8050dbaa None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:19.196226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15f58-3d3a-4012-8df8-8dd30fd960f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:19.197165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15f58-3d3a-4012-8df8-8dd30fd960f1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:19.197847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15f58-3d3a-4012-8df8-8dd30fd960f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:19.197847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15f58-3d3a-4012-8df8-8dd30fd960f1 None admin] PATH_INFO: `/v3/users/e089fd7ee1fd45e28c3ba762ac7831e1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:19.199062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15f58-3d3a-4012-8df8-8dd30fd960f1 None admin] RBAC: Authorizing `identity:get_user(user_id=e089fd7ee1fd45e28c3ba762ac7831e1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:19.200653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15f58-3d3a-4012-8df8-8dd30fd960f1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:19.202698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 149/308] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:19 2022] GET /identity/v3/users/e089fd7ee1fd45e28c3ba762ac7831e1 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:19.208224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15f58-3d3a-4012-8df8-8dd30fd960f1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:19.229149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95770c-3d5a-4d09-8874-cf8f33cb804a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:19.268427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b3123-efcc-4308-9832-3ebb1e06e8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:19.269640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3123-efcc-4308-9832-3ebb1e06e8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:19.270363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3123-efcc-4308-9832-3ebb1e06e8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:19.270840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3123-efcc-4308-9832-3ebb1e06e8f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:19.271858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b3123-efcc-4308-9832-3ebb1e06e8f8 None admin] RBAC: Adding query filter params (role.id=fb8aa50542444837855b787315bea7a9, user.id=d67cd152934c490984a239a7d711b72a, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:19.272397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b3123-efcc-4308-9832-3ebb1e06e8f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:19.274907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b3123-efcc-4308-9832-3ebb1e06e8f8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:19.289849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 160/309] 10.222.0.58 () {56 vars in 1308 bytes} [Mon May 16 17:26:19 2022] GET /identity/v3/role_assignments?user.id=d67cd152934c490984a239a7d711b72a&scope.system=all&role.id=fb8aa50542444837855b787315bea7a9 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:19.333166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15f58-3d3a-4012-8df8-8dd30fd960f1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:19.373757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44d6a2-2266-4126-9ea5-38a09eece869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:19.374974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44d6a2-2266-4126-9ea5-38a09eece869 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:19.375437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44d6a2-2266-4126-9ea5-38a09eece869 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:19.375894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44d6a2-2266-4126-9ea5-38a09eece869 None admin] PATH_INFO: `/v3/system/users/e089fd7ee1fd45e28c3ba762ac7831e1/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:19.377802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44d6a2-2266-4126-9ea5-38a09eece869 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e089fd7ee1fd45e28c3ba762ac7831e1, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:19.379400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44d6a2-2266-4126-9ea5-38a09eece869 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:19.391666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 150/310] 10.222.0.58 () {58 vars in 1334 bytes} [Mon May 16 17:26:19 2022] PUT /identity/v3/system/users/e089fd7ee1fd45e28c3ba762ac7831e1/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:20.174163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735107e5-f31e-4cbd-8896-1ef73fd6398b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:20.174708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735107e5-f31e-4cbd-8896-1ef73fd6398b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:20.174708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735107e5-f31e-4cbd-8896-1ef73fd6398b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:20.176355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 161/311] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:20.182006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691172-f808-40fc-a5eb-aab9a12f808d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:20.182399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691172-f808-40fc-a5eb-aab9a12f808d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:20.182581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691172-f808-40fc-a5eb-aab9a12f808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:20.199351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-dd691172-f808-40fc-a5eb-aab9a12f808d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:20.200968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dd691172-f808-40fc-a5eb-aab9a12f808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:20.266753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 151/312] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:20.289647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735107e5-f31e-4cbd-8896-1ef73fd6398b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:20.390607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735107e5-f31e-4cbd-8896-1ef73fd6398b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:20.424804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ab88-58c8-4222-9a20-c0f7f0652109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:20.425640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ab88-58c8-4222-9a20-c0f7f0652109 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:20.425925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ab88-58c8-4222-9a20-c0f7f0652109 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:20.426198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ab88-58c8-4222-9a20-c0f7f0652109 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:20.437784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3ab88-58c8-4222-9a20-c0f7f0652109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4ed3ab88-58c8-4222-9a20-c0f7f0652109 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:20.445447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:20.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:20.447145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 162/313] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:20.452752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd691172-f808-40fc-a5eb-aab9a12f808d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:20.553676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd691172-f808-40fc-a5eb-aab9a12f808d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:20.587186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:20.587855 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:20.588133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:20.588403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:20.589149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:20.589452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:20.590850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:20.599338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 152/314] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:20.604752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ab88-58c8-4222-9a20-c0f7f0652109 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:20.702504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ab88-58c8-4222-9a20-c0f7f0652109 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:20.734726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55073e78-d006-46c9-903c-d5a64430e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:20.735598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55073e78-d006-46c9-903c-d5a64430e846 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:20.735883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55073e78-d006-46c9-903c-d5a64430e846 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:20.736153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55073e78-d006-46c9-903c-d5a64430e846 None admin] PATH_INFO: `/v3/users/a1e6480734e948d890e9fe6061dd9f19` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:20.737318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55073e78-d006-46c9-903c-d5a64430e846 None admin] RBAC: Authorizing `identity:get_user(user_id=a1e6480734e948d890e9fe6061dd9f19)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:20.738807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55073e78-d006-46c9-903c-d5a64430e846 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:20.740778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 163/315] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:20 2022] GET /identity/v3/users/a1e6480734e948d890e9fe6061dd9f19 => generated 297 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:20.745936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:20.843193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64ab1-44a3-4616-bc1b-162269fe1798 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:20.876953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de29b17-2244-49cd-92fa-aea20620568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:20.877637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de29b17-2244-49cd-92fa-aea20620568c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:20.877920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de29b17-2244-49cd-92fa-aea20620568c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:20.878197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de29b17-2244-49cd-92fa-aea20620568c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:20.945382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de29b17-2244-49cd-92fa-aea20620568c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:20.946873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de29b17-2244-49cd-92fa-aea20620568c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:21.044025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 153/316] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 17:26:21.049665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55073e78-d006-46c9-903c-d5a64430e846 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:21.149464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55073e78-d006-46c9-903c-d5a64430e846 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:21.182403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21b894-c3a9-4b86-bd32-1103628b36fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:21.183273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b894-c3a9-4b86-bd32-1103628b36fb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.183560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b894-c3a9-4b86-bd32-1103628b36fb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.183835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b894-c3a9-4b86-bd32-1103628b36fb None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.185021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21b894-c3a9-4b86-bd32-1103628b36fb None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:21.186535 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21b894-c3a9-4b86-bd32-1103628b36fb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:21.188566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 164/317] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:21 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:21.194386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de29b17-2244-49cd-92fa-aea20620568c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:21.299320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de29b17-2244-49cd-92fa-aea20620568c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:21.333164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664759be-de5c-42d2-b3f7-7d7409d221d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:21.333854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664759be-de5c-42d2-b3f7-7d7409d221d5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.334135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664759be-de5c-42d2-b3f7-7d7409d221d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.334407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664759be-de5c-42d2-b3f7-7d7409d221d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.335235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664759be-de5c-42d2-b3f7-7d7409d221d5 None admin] RBAC: Adding query filter params (role.id=fb8aa50542444837855b787315bea7a9, scope.project.id=938f6968326342b59e88886f73e95b00, user.id=a1e6480734e948d890e9fe6061dd9f19) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:21.335541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664759be-de5c-42d2-b3f7-7d7409d221d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:21.336988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664759be-de5c-42d2-b3f7-7d7409d221d5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:21.342959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 154/318] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:21 2022] GET /identity/v3/role_assignments?user.id=a1e6480734e948d890e9fe6061dd9f19&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=fb8aa50542444837855b787315bea7a9 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:21.407250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7b83-cfb4-40f5-98f4-76119ae0a664 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.407586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7b83-cfb4-40f5-98f4-76119ae0a664 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.407797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7b83-cfb4-40f5-98f4-76119ae0a664 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.409585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 165/319] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:21.415661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50880e5-936e-45f7-a2f0-0d2261ae988c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.416022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50880e5-936e-45f7-a2f0-0d2261ae988c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.416202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50880e5-936e-45f7-a2f0-0d2261ae988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.435400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d50880e5-936e-45f7-a2f0-0d2261ae988c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:21.436753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d50880e5-936e-45f7-a2f0-0d2261ae988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:21.518739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 155/320] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:21.542188 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7b83-cfb4-40f5-98f4-76119ae0a664 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:21.588276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba74a-2955-4739-b915-39a048b1907d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.588464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba74a-2955-4739-b915-39a048b1907d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.588741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba74a-2955-4739-b915-39a048b1907d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.590433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 156/321] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:21.595419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272c86-3b69-4182-9cf5-a0ec15d62f02 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.595702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272c86-3b69-4182-9cf5-a0ec15d62f02 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.595976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272c86-3b69-4182-9cf5-a0ec15d62f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.612914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c1272c86-3b69-4182-9cf5-a0ec15d62f02 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:21.614176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c1272c86-3b69-4182-9cf5-a0ec15d62f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:21.655765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7b83-cfb4-40f5-98f4-76119ae0a664 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:21.687301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4246-63ef-49f0-a30f-138c2205e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:21.688087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4246-63ef-49f0-a30f-138c2205e35f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.688367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4246-63ef-49f0-a30f-138c2205e35f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.688638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4246-63ef-49f0-a30f-138c2205e35f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.689689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 157/322] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:21.689836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4246-63ef-49f0-a30f-138c2205e35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:21.691233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4246-63ef-49f0-a30f-138c2205e35f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:21.691375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82305f-315c-44ef-9b11-3e9e972f5fdc None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.691590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82305f-315c-44ef-9b11-3e9e972f5fdc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.691861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82305f-315c-44ef-9b11-3e9e972f5fdc None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.697354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 166/323] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:21.697483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 158/324] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:21.698230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4246-63ef-49f0-a30f-138c2205e35f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:21.698579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d33dc-b6fb-4c52-8547-ef3929730173 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.698928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d33dc-b6fb-4c52-8547-ef3929730173 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.699128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d33dc-b6fb-4c52-8547-ef3929730173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.714910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-263d33dc-b6fb-4c52-8547-ef3929730173 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:21.716071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-263d33dc-b6fb-4c52-8547-ef3929730173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:21.781188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 159/325] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:21.781938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d33dc-b6fb-4c52-8547-ef3929730173 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:21.802276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4246-63ef-49f0-a30f-138c2205e35f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:21.834089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4d52a-6121-4a77-8776-8118aa1c6fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:21.834752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d52a-6121-4a77-8776-8118aa1c6fbe None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.835032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d52a-6121-4a77-8776-8118aa1c6fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.835288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4d52a-6121-4a77-8776-8118aa1c6fbe None admin] PATH_INFO: `/v3/groups` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.835962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4d52a-6121-4a77-8776-8118aa1c6fbe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:21.837399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4d52a-6121-4a77-8776-8118aa1c6fbe None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:21.858476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 167/326] 10.222.0.58 () {60 vars in 1134 bytes} [Mon May 16 17:26:21 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:21.858476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4d52a-6121-4a77-8776-8118aa1c6fbe None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:21.885052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d33dc-b6fb-4c52-8547-ef3929730173 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:21.929071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d335c-b608-4bc4-9da2-5dc215b29c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:21.930098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d335c-b608-4bc4-9da2-5dc215b29c47 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:21.930380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d335c-b608-4bc4-9da2-5dc215b29c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:21.930660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d335c-b608-4bc4-9da2-5dc215b29c47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:21.942457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d335c-b608-4bc4-9da2-5dc215b29c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-989d335c-b608-4bc4-9da2-5dc215b29c47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:21.950490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:21.951698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:21.952645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 160/327] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:21.957951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d335c-b608-4bc4-9da2-5dc215b29c47 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:21.981308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4d52a-6121-4a77-8776-8118aa1c6fbe None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:22.019181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc09cf-3977-4d09-a87c-b2d982f27f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:22.019994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc09cf-3977-4d09-a87c-b2d982f27f9e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:22.020291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc09cf-3977-4d09-a87c-b2d982f27f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:22.020549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc09cf-3977-4d09-a87c-b2d982f27f9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:22.031961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc09cf-3977-4d09-a87c-b2d982f27f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-34fc09cf-3977-4d09-a87c-b2d982f27f9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:22.039719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:22.040608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:22.041400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 168/328] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:22.047310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc09cf-3977-4d09-a87c-b2d982f27f9e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:22.067295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d335c-b608-4bc4-9da2-5dc215b29c47 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:22.100686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:22.101357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:22.101662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:22.101942 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:22.103256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:22.103256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:22.104351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:22.113253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 161/329] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:22.119950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:22.161895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc09cf-3977-4d09-a87c-b2d982f27f9e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:22.196272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:22.196994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:22.197226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:22.197480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:22.198498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:22.198603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:22.199955 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:22.208835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 169/330] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:22.215022 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:22.237641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a8148-dafb-4fe7-a226-cacf20acd16e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:22.272571 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097bd7c-fc1f-4f8a-9ad2-5ab7feefa45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:22.273457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097bd7c-fc1f-4f8a-9ad2-5ab7feefa45a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:22.273768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097bd7c-fc1f-4f8a-9ad2-5ab7feefa45a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:22.274044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097bd7c-fc1f-4f8a-9ad2-5ab7feefa45a None admin] PATH_INFO: `/v3/users/d67cd152934c490984a239a7d711b72a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:22.275248 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097bd7c-fc1f-4f8a-9ad2-5ab7feefa45a None admin] RBAC: Authorizing `identity:get_user(user_id=d67cd152934c490984a239a7d711b72a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:22.276698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097bd7c-fc1f-4f8a-9ad2-5ab7feefa45a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:22.278812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 162/331] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:22 2022] GET /identity/v3/users/d67cd152934c490984a239a7d711b72a => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:22.285787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097bd7c-fc1f-4f8a-9ad2-5ab7feefa45a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:22.316288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1766ec-8fc5-4126-bd94-bb267b8f791e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:22.350253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944885-5366-4372-b064-57269aa18af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:22.351138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944885-5366-4372-b064-57269aa18af1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:22.351415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944885-5366-4372-b064-57269aa18af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:22.351684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944885-5366-4372-b064-57269aa18af1 None admin] PATH_INFO: `/v3/users/e089fd7ee1fd45e28c3ba762ac7831e1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:22.352885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a944885-5366-4372-b064-57269aa18af1 None admin] RBAC: Authorizing `identity:get_user(user_id=e089fd7ee1fd45e28c3ba762ac7831e1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:22.354360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a944885-5366-4372-b064-57269aa18af1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:22.356395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 170/332] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:22 2022] GET /identity/v3/users/e089fd7ee1fd45e28c3ba762ac7831e1 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:22.362664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944885-5366-4372-b064-57269aa18af1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:22.389175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097bd7c-fc1f-4f8a-9ad2-5ab7feefa45a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:22.422074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22444107-19fc-45d8-ab46-eca86b0dc807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:22.422951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444107-19fc-45d8-ab46-eca86b0dc807 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:22.423235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444107-19fc-45d8-ab46-eca86b0dc807 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:22.423516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444107-19fc-45d8-ab46-eca86b0dc807 None admin] PATH_INFO: `/v3/system/users/d67cd152934c490984a239a7d711b72a/roles/fb8aa50542444837855b787315bea7a9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:22.424986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22444107-19fc-45d8-ab46-eca86b0dc807 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d67cd152934c490984a239a7d711b72a, role_id=fb8aa50542444837855b787315bea7a9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:22.426402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22444107-19fc-45d8-ab46-eca86b0dc807 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:22.435539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 163/333] 10.222.0.58 () {58 vars in 1334 bytes} [Mon May 16 17:26:22 2022] PUT /identity/v3/system/users/d67cd152934c490984a239a7d711b72a/roles/fb8aa50542444837855b787315bea7a9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:22.472282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944885-5366-4372-b064-57269aa18af1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:22.509380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccdc49-c758-4643-87c8-b731fa540398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:22.510109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccdc49-c758-4643-87c8-b731fa540398 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:22.510390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccdc49-c758-4643-87c8-b731fa540398 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:22.510663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccdc49-c758-4643-87c8-b731fa540398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:22.511508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccdc49-c758-4643-87c8-b731fa540398 None admin] RBAC: Adding query filter params (role.id=c9deaccdca814832a7d143419fd1d54f, user.id=e089fd7ee1fd45e28c3ba762ac7831e1, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:22.511818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccdc49-c758-4643-87c8-b731fa540398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:22.513301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccdc49-c758-4643-87c8-b731fa540398 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:22.527405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 171/334] 10.222.0.58 () {56 vars in 1308 bytes} [Mon May 16 17:26:22 2022] GET /identity/v3/role_assignments?user.id=e089fd7ee1fd45e28c3ba762ac7831e1&scope.system=all&role.id=c9deaccdca814832a7d143419fd1d54f => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:24.593116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0770-31fb-4bc9-86fe-16628fd9dba6 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:24.594178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0770-31fb-4bc9-86fe-16628fd9dba6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:24.594678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0770-31fb-4bc9-86fe-16628fd9dba6 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:24.596487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 164/335] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:24.602316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ca03a-136f-4ac5-863c-3fdb0a4a224c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:24.603156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ca03a-136f-4ac5-863c-3fdb0a4a224c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:24.603650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ca03a-136f-4ac5-863c-3fdb0a4a224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:24.622039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-da5ca03a-136f-4ac5-863c-3fdb0a4a224c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:24.623682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-da5ca03a-136f-4ac5-863c-3fdb0a4a224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:24.692516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 172/336] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:24.717049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c0770-31fb-4bc9-86fe-16628fd9dba6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:24.825061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c0770-31fb-4bc9-86fe-16628fd9dba6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:24.860192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2149b-6a40-4628-9d13-b5aa24248e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:24.861336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2149b-6a40-4628-9d13-b5aa24248e18 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:24.861849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2149b-6a40-4628-9d13-b5aa24248e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:24.862315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2149b-6a40-4628-9d13-b5aa24248e18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:24.874941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2149b-6a40-4628-9d13-b5aa24248e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-01c2149b-6a40-4628-9d13-b5aa24248e18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:24.883380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:24.884285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:24.885070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:24.887471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 165/337] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:24.893500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ca03a-136f-4ac5-863c-3fdb0a4a224c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:24.931614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58b108-0f63-41a0-9678-2cf1d495b6db None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:24.932262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58b108-0f63-41a0-9678-2cf1d495b6db None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:24.932733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58b108-0f63-41a0-9678-2cf1d495b6db None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:24.934330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 166/338] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:24.939842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664515-81fb-4e1f-836c-17eb7b0ffbe9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:24.940373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664515-81fb-4e1f-836c-17eb7b0ffbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:24.940845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664515-81fb-4e1f-836c-17eb7b0ffbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:24.958176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-94664515-81fb-4e1f-836c-17eb7b0ffbe9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:24.959681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-94664515-81fb-4e1f-836c-17eb7b0ffbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:25.005006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ca03a-136f-4ac5-863c-3fdb0a4a224c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.034208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 167/339] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:25.040323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.041005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.041284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.041573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.042319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:25.042619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:25.043994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:25.052957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 173/340] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:25.058460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94664515-81fb-4e1f-836c-17eb7b0ffbe9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.072894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.160021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94664515-81fb-4e1f-836c-17eb7b0ffbe9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.189464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744e8b3-d1af-4976-b9b7-2e90f3ac4ad1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.195697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a56d-7d45-4874-b404-8a05afccddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.196695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a56d-7d45-4874-b404-8a05afccddb3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.197170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a56d-7d45-4874-b404-8a05afccddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.197667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a56d-7d45-4874-b404-8a05afccddb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.230779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485542d-93cf-48c1-86d6-7a7a198fe10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.231604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485542d-93cf-48c1-86d6-7a7a198fe10c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.231885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485542d-93cf-48c1-86d6-7a7a198fe10c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.232153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485542d-93cf-48c1-86d6-7a7a198fe10c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.242534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485542d-93cf-48c1-86d6-7a7a198fe10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c485542d-93cf-48c1-86d6-7a7a198fe10c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:25.250332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:25.251212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:25.252003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 174/341] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:25.253121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9086304-7738-4273-a639-c6490bdbf805 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.253397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9086304-7738-4273-a639-c6490bdbf805 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.257788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9086304-7738-4273-a639-c6490bdbf805 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.259481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 175/342] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:25.260926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9086304-7738-4273-a639-c6490bdbf805 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.271415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7a56d-7d45-4874-b404-8a05afccddb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:25.273193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7a56d-7d45-4874-b404-8a05afccddb3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:25.360827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9086304-7738-4273-a639-c6490bdbf805 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.371443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 168/343] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:25.373148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375f07d-5adb-45e7-8634-9f3661eed70f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.374710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375f07d-5adb-45e7-8634-9f3661eed70f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.375205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375f07d-5adb-45e7-8634-9f3661eed70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.392458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3375f07d-5adb-45e7-8634-9f3661eed70f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:25.394084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3375f07d-5adb-45e7-8634-9f3661eed70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:25.400701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.401389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.401703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.401972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.402739 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:25.403038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:25.404790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:25.414727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 176/344] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:25.415467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.467726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 169/345] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:25.468916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375f07d-5adb-45e7-8634-9f3661eed70f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.519124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391a95e-9d4d-431c-a915-bf6a3aefae52 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.552714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce7e6f-92ab-49b8-a723-fd29f037d61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.553447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce7e6f-92ab-49b8-a723-fd29f037d61a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.553749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce7e6f-92ab-49b8-a723-fd29f037d61a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.554018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce7e6f-92ab-49b8-a723-fd29f037d61a None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.555198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce7e6f-92ab-49b8-a723-fd29f037d61a None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:25.556875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce7e6f-92ab-49b8-a723-fd29f037d61a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:25.558344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 177/346] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:25.559091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce7e6f-92ab-49b8-a723-fd29f037d61a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.568989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375f07d-5adb-45e7-8634-9f3661eed70f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.603577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf0d0f-3124-4cd2-a4da-9fdcd201cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.605027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf0d0f-3124-4cd2-a4da-9fdcd201cf1e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.605500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf0d0f-3124-4cd2-a4da-9fdcd201cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.606009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf0d0f-3124-4cd2-a4da-9fdcd201cf1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.665135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce7e6f-92ab-49b8-a723-fd29f037d61a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.674959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf0d0f-3124-4cd2-a4da-9fdcd201cf1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:25.677125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf0d0f-3124-4cd2-a4da-9fdcd201cf1e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:25.701238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d7ec0-b1a9-4c4c-b674-8b1eb8df9793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.702326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d7ec0-b1a9-4c4c-b674-8b1eb8df9793 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.702326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d7ec0-b1a9-4c4c-b674-8b1eb8df9793 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.702602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d7ec0-b1a9-4c4c-b674-8b1eb8df9793 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.713778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d7ec0-b1a9-4c4c-b674-8b1eb8df9793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-137d7ec0-b1a9-4c4c-b674-8b1eb8df9793 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:25.721479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:25.722549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:25.723351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 178/347] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:25.724024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d7ec0-b1a9-4c4c-b674-8b1eb8df9793 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.780374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 170/348] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:25.781577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf0d0f-3124-4cd2-a4da-9fdcd201cf1e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.826520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d7ec0-b1a9-4c4c-b674-8b1eb8df9793 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.859697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500d74a-b3b5-427f-8dd1-d5f5dbe188a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.860560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500d74a-b3b5-427f-8dd1-d5f5dbe188a8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.860834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500d74a-b3b5-427f-8dd1-d5f5dbe188a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.861101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500d74a-b3b5-427f-8dd1-d5f5dbe188a8 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.867073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500d74a-b3b5-427f-8dd1-d5f5dbe188a8 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:25.868532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500d74a-b3b5-427f-8dd1-d5f5dbe188a8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:25.870564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 179/349] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:25.871321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500d74a-b3b5-427f-8dd1-d5f5dbe188a8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.881310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf0d0f-3124-4cd2-a4da-9fdcd201cf1e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:25.915407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ea602-58b6-4866-9c09-66efa7c8095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:25.916407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ea602-58b6-4866-9c09-66efa7c8095d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.916903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ea602-58b6-4866-9c09-66efa7c8095d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.917367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ea602-58b6-4866-9c09-66efa7c8095d None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.918354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ea602-58b6-4866-9c09-66efa7c8095d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:25.918850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ea602-58b6-4866-9c09-66efa7c8095d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:25.920447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ea602-58b6-4866-9c09-66efa7c8095d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:25.929207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 171/350] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:25.930793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f862-eea4-471d-8525-fee210ecbd02 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:25.931277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f862-eea4-471d-8525-fee210ecbd02 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:25.931741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f862-eea4-471d-8525-fee210ecbd02 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:25.933424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 172/351] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:25.934334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f862-eea4-471d-8525-fee210ecbd02 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:25.975104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500d74a-b3b5-427f-8dd1-d5f5dbe188a8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.007285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92753e5d-4cd3-4908-a67f-e0103ee5cb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.008147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753e5d-4cd3-4908-a67f-e0103ee5cb3a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.008421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753e5d-4cd3-4908-a67f-e0103ee5cb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.008689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753e5d-4cd3-4908-a67f-e0103ee5cb3a None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.009876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92753e5d-4cd3-4908-a67f-e0103ee5cb3a None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:26.011301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92753e5d-4cd3-4908-a67f-e0103ee5cb3a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:26.013409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 180/352] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:26.014452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83d32-20d2-46bd-9c1a-96168aed752b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.014797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83d32-20d2-46bd-9c1a-96168aed752b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.014996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83d32-20d2-46bd-9c1a-96168aed752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.035912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f862-eea4-471d-8525-fee210ecbd02 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.038195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-dfb83d32-20d2-46bd-9c1a-96168aed752b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:26.039338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-dfb83d32-20d2-46bd-9c1a-96168aed752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:26.079547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.079547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.079547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.079547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.080116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] RBAC: Adding query filter params (group.id=fda88656aff849899a0f2907ded1aa5f, role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=0463b87212e547209f1edc8f93d9401a) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:26.080361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:26.081959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:26.087855 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 173/353] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:25 2022] GET /identity/v3/role_assignments?group.id=fda88656aff849899a0f2907ded1aa5f&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:26.090413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:26.121050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 181/354] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:26.123007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb83d32-20d2-46bd-9c1a-96168aed752b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:26.215124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4a7bd-0361-4328-9f69-280264708dd8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.249890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb83d32-20d2-46bd-9c1a-96168aed752b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.251730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91ca70-d9bb-4c43-a158-04a8f42c4575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.253180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91ca70-d9bb-4c43-a158-04a8f42c4575 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.253180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91ca70-d9bb-4c43-a158-04a8f42c4575 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.257008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91ca70-d9bb-4c43-a158-04a8f42c4575 None admin] PATH_INFO: `/v3/users/d67cd152934c490984a239a7d711b72a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.257008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91ca70-d9bb-4c43-a158-04a8f42c4575 None admin] RBAC: Authorizing `identity:get_user(user_id=d67cd152934c490984a239a7d711b72a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:26.257008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91ca70-d9bb-4c43-a158-04a8f42c4575 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:26.261725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 174/355] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:26:26 2022] GET /identity/v3/users/d67cd152934c490984a239a7d711b72a => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:26.261725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91ca70-d9bb-4c43-a158-04a8f42c4575 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:26.350378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3202c-e635-4728-b58e-90a64d5bd055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.351345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3202c-e635-4728-b58e-90a64d5bd055 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.351620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3202c-e635-4728-b58e-90a64d5bd055 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.351890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3202c-e635-4728-b58e-90a64d5bd055 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.353582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3202c-e635-4728-b58e-90a64d5bd055 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:26.355122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3202c-e635-4728-b58e-90a64d5bd055 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:26.356798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 182/356] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:26 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:26.359713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3202c-e635-4728-b58e-90a64d5bd055 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:26.397040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91ca70-d9bb-4c43-a158-04a8f42c4575 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.438508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ec333-d7ec-4f12-838d-f9e9c395b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.439309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ec333-d7ec-4f12-838d-f9e9c395b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.439583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ec333-d7ec-4f12-838d-f9e9c395b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.439851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ec333-d7ec-4f12-838d-f9e9c395b1b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.461078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ec333-d7ec-4f12-838d-f9e9c395b1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-398ec333-d7ec-4f12-838d-f9e9c395b1b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:26.473988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:26.474969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:26.475912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 175/357] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:26.476603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ec333-d7ec-4f12-838d-f9e9c395b1b8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:26.507115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3202c-e635-4728-b58e-90a64d5bd055 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.547666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.548326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.548595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.548856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.549712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] RBAC: Adding query filter params (role.id=fb8aa50542444837855b787315bea7a9, user.id=d67cd152934c490984a239a7d711b72a, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:26.550014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:26.554700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:26.575353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 183/358] 10.222.0.58 () {56 vars in 1308 bytes} [Mon May 16 17:26:26 2022] GET /identity/v3/role_assignments?user.id=d67cd152934c490984a239a7d711b72a&scope.system=all&role.id=fb8aa50542444837855b787315bea7a9 => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:26.578581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:26.695718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ec333-d7ec-4f12-838d-f9e9c395b1b8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.731270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26339831-65db-49ca-ba3f-065a00d500db None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.768390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.769068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.769341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.769653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.770567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:26.770896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:26.772304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:26.774858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd3a7c-9ea9-4995-9d80-08c5a081446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.775543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd3a7c-9ea9-4995-9d80-08c5a081446f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.775821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd3a7c-9ea9-4995-9d80-08c5a081446f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.776092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd3a7c-9ea9-4995-9d80-08c5a081446f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:26.776929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd3a7c-9ea9-4995-9d80-08c5a081446f None admin] RBAC: Adding query filter params (group.id=fda88656aff849899a0f2907ded1aa5f, role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=0463b87212e547209f1edc8f93d9401a) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:26.777231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd3a7c-9ea9-4995-9d80-08c5a081446f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:26.778705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd3a7c-9ea9-4995-9d80-08c5a081446f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:26.781923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 184/359] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:26.788403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:26.795729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 176/360] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:26 2022] GET /identity/v3/role_assignments?group.id=fda88656aff849899a0f2907ded1aa5f&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=c9deaccdca814832a7d143419fd1d54f => generated 260 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:26.902414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431674a-3b02-45be-971a-75fa3b624b9b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:26.938362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e460b5c-846c-4462-b2c2-85ca816b6d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:26.939024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460b5c-846c-4462-b2c2-85ca816b6d61 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:26.939298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460b5c-846c-4462-b2c2-85ca816b6d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:26.939568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460b5c-846c-4462-b2c2-85ca816b6d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.011462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e460b5c-846c-4462-b2c2-85ca816b6d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:27.012945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e460b5c-846c-4462-b2c2-85ca816b6d61 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:27.063974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61000263-f934-4efb-8ebd-ff6f0fa19a91 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.064309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61000263-f934-4efb-8ebd-ff6f0fa19a91 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.064520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61000263-f934-4efb-8ebd-ff6f0fa19a91 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.066333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 177/361] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:27.072066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019bfad-a519-4ba4-b11a-2a3f46374e3b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.072367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019bfad-a519-4ba4-b11a-2a3f46374e3b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.072609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019bfad-a519-4ba4-b11a-2a3f46374e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.113601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e019bfad-a519-4ba4-b11a-2a3f46374e3b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:27.115155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e019bfad-a519-4ba4-b11a-2a3f46374e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:27.124184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 185/362] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 17:26:27.130563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e460b5c-846c-4462-b2c2-85ca816b6d61 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:27.256761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e460b5c-846c-4462-b2c2-85ca816b6d61 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:27.287378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 178/363] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:27.296552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518e34d-f587-4fb6-afd8-481ea97776ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:27.297631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e34d-f587-4fb6-afd8-481ea97776ba None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.298057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e34d-f587-4fb6-afd8-481ea97776ba None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.298466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e34d-f587-4fb6-afd8-481ea97776ba None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.301049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518e34d-f587-4fb6-afd8-481ea97776ba None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:27.303109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518e34d-f587-4fb6-afd8-481ea97776ba None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:27.305224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 186/364] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:27 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:27.310882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019bfad-a519-4ba4-b11a-2a3f46374e3b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:27.315603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518e34d-f587-4fb6-afd8-481ea97776ba None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:27.432368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518e34d-f587-4fb6-afd8-481ea97776ba None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:27.464609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019bfad-a519-4ba4-b11a-2a3f46374e3b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:27.473136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b928e7-41ae-4ce8-b714-d97f788b4567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:27.474008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b928e7-41ae-4ce8-b714-d97f788b4567 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.474280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b928e7-41ae-4ce8-b714-d97f788b4567 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.474546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b928e7-41ae-4ce8-b714-d97f788b4567 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.490046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b928e7-41ae-4ce8-b714-d97f788b4567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b4b928e7-41ae-4ce8-b714-d97f788b4567 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:27.500352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:27.501280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:27.502472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 187/365] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:27.503161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ca905-76b3-454c-a892-8a312a6f8f9f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.503498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ca905-76b3-454c-a892-8a312a6f8f9f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.503658 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ca905-76b3-454c-a892-8a312a6f8f9f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.506459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 188/366] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:27.509918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ca905-76b3-454c-a892-8a312a6f8f9f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:27.512693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6679973-859f-4a71-8bb0-ff4375d5c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:27.515790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6679973-859f-4a71-8bb0-ff4375d5c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.516286 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6679973-859f-4a71-8bb0-ff4375d5c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.516760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6679973-859f-4a71-8bb0-ff4375d5c9a3 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.518964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6679973-859f-4a71-8bb0-ff4375d5c9a3 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:27.520610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6679973-859f-4a71-8bb0-ff4375d5c9a3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:27.523637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 179/367] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:27 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:27.524891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae806-2792-4ab3-a316-55c28929fc90 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.525170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae806-2792-4ab3-a316-55c28929fc90 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.525437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae806-2792-4ab3-a316-55c28929fc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.547518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b11ae806-2792-4ab3-a316-55c28929fc90 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:27.548972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b11ae806-2792-4ab3-a316-55c28929fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:27.620530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 180/368] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:27.621816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae806-2792-4ab3-a316-55c28929fc90 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:27.639511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ca905-76b3-454c-a892-8a312a6f8f9f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:27.681815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:27.682503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.683141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.683422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.684534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:27.684853 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:27.686882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:27.697646 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 189/369] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:27.698614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:27.756714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae806-2792-4ab3-a316-55c28929fc90 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:27.800140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:27.801157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.802404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.802884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.804100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] RBAC: Adding query filter params (group.id=fda88656aff849899a0f2907ded1aa5f, role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=938f6968326342b59e88886f73e95b00) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:27.804790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:27.806992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:27.815117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 181/370] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:27 2022] GET /identity/v3/role_assignments?group.id=fda88656aff849899a0f2907ded1aa5f&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=c9deaccdca814832a7d143419fd1d54f => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:27.815676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676da9a0-c832-42d1-8bbf-4009779f25f9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:27.816796 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:27.887412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a9991-1469-4363-8583-5ad4bdd115cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:27.888240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9991-1469-4363-8583-5ad4bdd115cc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:27.888654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9991-1469-4363-8583-5ad4bdd115cc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:27.888921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9991-1469-4363-8583-5ad4bdd115cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:27.915603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a9991-1469-4363-8583-5ad4bdd115cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2e4a9991-1469-4363-8583-5ad4bdd115cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:27.930423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:27.931423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:27.932208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 190/371] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:27.937644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a9991-1469-4363-8583-5ad4bdd115cc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:28.010641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a8e83-48bb-4de0-b76e-81134a2bed39 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:28.052378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab097e-bd6a-46ee-8826-8fb279c7d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:28.052969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab097e-bd6a-46ee-8826-8fb279c7d196 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:28.053248 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab097e-bd6a-46ee-8826-8fb279c7d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:28.053520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab097e-bd6a-46ee-8826-8fb279c7d196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:28.098326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a9991-1469-4363-8583-5ad4bdd115cc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:28.124123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab097e-bd6a-46ee-8826-8fb279c7d196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:28.125609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab097e-bd6a-46ee-8826-8fb279c7d196 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:28.131241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:28.131912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:28.132186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:28.132450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:28.133186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:28.133483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:28.134866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:28.149310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 191/372] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:28.154832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:28.243977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 182/373] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:28.254592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab097e-bd6a-46ee-8826-8fb279c7d196 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:28.280036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf2002-e720-4e27-9353-2ed08da4e7f6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:28.320096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584f3aa-9aa6-4a0e-b1bd-35d8d5e860fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:28.321631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584f3aa-9aa6-4a0e-b1bd-35d8d5e860fe None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:28.322289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584f3aa-9aa6-4a0e-b1bd-35d8d5e860fe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:28.322949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584f3aa-9aa6-4a0e-b1bd-35d8d5e860fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:28.375784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab097e-bd6a-46ee-8826-8fb279c7d196 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:28.409862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c62b80-2dd0-4d59-83b7-9f7e5e2d63ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:28.410716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c62b80-2dd0-4d59-83b7-9f7e5e2d63ee None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:28.410990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c62b80-2dd0-4d59-83b7-9f7e5e2d63ee None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:28.411260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c62b80-2dd0-4d59-83b7-9f7e5e2d63ee None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:28.412863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c62b80-2dd0-4d59-83b7-9f7e5e2d63ee None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:28.414439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c62b80-2dd0-4d59-83b7-9f7e5e2d63ee None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:28.416643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 183/374] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:28 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:28.425382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c62b80-2dd0-4d59-83b7-9f7e5e2d63ee None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:28.460086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584f3aa-9aa6-4a0e-b1bd-35d8d5e860fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:28.465876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584f3aa-9aa6-4a0e-b1bd-35d8d5e860fe None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:28.580466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 192/375] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:28.585832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584f3aa-9aa6-4a0e-b1bd-35d8d5e860fe None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:28.629221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c62b80-2dd0-4d59-83b7-9f7e5e2d63ee None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:28.690538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584f3aa-9aa6-4a0e-b1bd-35d8d5e860fe None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:28.695198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba281f1a-25f8-48eb-8bfe-6c14cfadf0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:28.696235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba281f1a-25f8-48eb-8bfe-6c14cfadf0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:28.696652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba281f1a-25f8-48eb-8bfe-6c14cfadf0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:28.697053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba281f1a-25f8-48eb-8bfe-6c14cfadf0c4 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:28.698413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba281f1a-25f8-48eb-8bfe-6c14cfadf0c4 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:28.705568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba281f1a-25f8-48eb-8bfe-6c14cfadf0c4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:28.707853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 184/376] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:28 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:28.713502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba281f1a-25f8-48eb-8bfe-6c14cfadf0c4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:28.724392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f5c93-a3a3-458d-b4b5-d42a40a171a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:28.729582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f5c93-a3a3-458d-b4b5-d42a40a171a2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:28.729582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f5c93-a3a3-458d-b4b5-d42a40a171a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:28.729582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f5c93-a3a3-458d-b4b5-d42a40a171a2 None admin] PATH_INFO: `/v3/projects/ab7c1a113cb54758aa563ff3298e430c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:28.732539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f5c93-a3a3-458d-b4b5-d42a40a171a2 None admin] RBAC: Authorizing `identity:get_project(project_id=ab7c1a113cb54758aa563ff3298e430c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:28.734203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f5c93-a3a3-458d-b4b5-d42a40a171a2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:28.737986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 193/377] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:28 2022] GET /identity/v3/projects/ab7c1a113cb54758aa563ff3298e430c => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:28.743597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f5c93-a3a3-458d-b4b5-d42a40a171a2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:28.843809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f5c93-a3a3-458d-b4b5-d42a40a171a2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:28.878596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d04ba-9f17-41e5-ade9-98a8af32e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:28.879697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d04ba-9f17-41e5-ade9-98a8af32e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:28.880144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d04ba-9f17-41e5-ade9-98a8af32e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:28.880562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d04ba-9f17-41e5-ade9-98a8af32e1a4 None admin] PATH_INFO: `/v3/groups/465441d5f3d14e4ca4b07c3061baab8d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:28.886253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d04ba-9f17-41e5-ade9-98a8af32e1a4 None admin] RBAC: Authorizing `identity:get_group(group_id=465441d5f3d14e4ca4b07c3061baab8d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:28.887946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d04ba-9f17-41e5-ade9-98a8af32e1a4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:28.890376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 194/378] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:28 2022] GET /identity/v3/groups/465441d5f3d14e4ca4b07c3061baab8d => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:28.896456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d04ba-9f17-41e5-ade9-98a8af32e1a4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:28.945216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba281f1a-25f8-48eb-8bfe-6c14cfadf0c4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:29.004881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d04ba-9f17-41e5-ade9-98a8af32e1a4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:29.027150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc1935-7ce0-4309-b894-6b54964a7cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:29.027823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1935-7ce0-4309-b894-6b54964a7cea None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.028098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1935-7ce0-4309-b894-6b54964a7cea None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.028368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1935-7ce0-4309-b894-6b54964a7cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.029264 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc1935-7ce0-4309-b894-6b54964a7cea None admin] RBAC: Adding query filter params (group.id=fda88656aff849899a0f2907ded1aa5f, role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=938f6968326342b59e88886f73e95b00) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:29.029585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc1935-7ce0-4309-b894-6b54964a7cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:29.031095 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc1935-7ce0-4309-b894-6b54964a7cea None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:29.040472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878c3b7-d5fa-46d3-816d-8efccef7ecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:29.041398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878c3b7-d5fa-46d3-816d-8efccef7ecd5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.041891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878c3b7-d5fa-46d3-816d-8efccef7ecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.042305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878c3b7-d5fa-46d3-816d-8efccef7ecd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.043382 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878c3b7-d5fa-46d3-816d-8efccef7ecd5 None admin] RBAC: Adding query filter params (group.id=465441d5f3d14e4ca4b07c3061baab8d, role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=ab7c1a113cb54758aa563ff3298e430c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:29.043828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878c3b7-d5fa-46d3-816d-8efccef7ecd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:29.045481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878c3b7-d5fa-46d3-816d-8efccef7ecd5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:29.047527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 185/379] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:28 2022] GET /identity/v3/role_assignments?group.id=fda88656aff849899a0f2907ded1aa5f&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 260 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:29.052590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 195/380] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:28 2022] GET /identity/v3/role_assignments?group.id=465441d5f3d14e4ca4b07c3061baab8d&scope.project.id=ab7c1a113cb54758aa563ff3298e430c&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:29.156332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba167ec-a183-410c-92bf-e2ee9c58720a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.156629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba167ec-a183-410c-92bf-e2ee9c58720a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.156808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba167ec-a183-410c-92bf-e2ee9c58720a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.158471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 186/381] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:29.164219 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43fb81-d1e9-411d-84e1-c9d93b0c4e52 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.164931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43fb81-d1e9-411d-84e1-c9d93b0c4e52 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.165398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43fb81-d1e9-411d-84e1-c9d93b0c4e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.193278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ab43fb81-d1e9-411d-84e1-c9d93b0c4e52 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:29.193278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ab43fb81-d1e9-411d-84e1-c9d93b0c4e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:29.291960 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 196/382] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:29.321332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba167ec-a183-410c-92bf-e2ee9c58720a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:29.431084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba167ec-a183-410c-92bf-e2ee9c58720a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:29.469542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934914b-63ac-445d-aa56-41dac6269d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:29.470466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934914b-63ac-445d-aa56-41dac6269d9f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.470739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934914b-63ac-445d-aa56-41dac6269d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.471006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934914b-63ac-445d-aa56-41dac6269d9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.481403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934914b-63ac-445d-aa56-41dac6269d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8934914b-63ac-445d-aa56-41dac6269d9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:29.491623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:29.492556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:29.493355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 187/383] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:29.498897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43fb81-d1e9-411d-84e1-c9d93b0c4e52 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:29.630416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43fb81-d1e9-411d-84e1-c9d93b0c4e52 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:29.678805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb132c-c7d0-4c63-b415-eba56eb66508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:29.679310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb132c-c7d0-4c63-b415-eba56eb66508 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.679591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb132c-c7d0-4c63-b415-eba56eb66508 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.679867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb132c-c7d0-4c63-b415-eba56eb66508 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.680617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb132c-c7d0-4c63-b415-eba56eb66508 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:29.680919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb132c-c7d0-4c63-b415-eba56eb66508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:29.682385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb132c-c7d0-4c63-b415-eba56eb66508 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:29.697262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 197/384] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:29.703653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934914b-63ac-445d-aa56-41dac6269d9f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:29.825122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007122-7e2e-4a1b-848f-361789a291d4 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.825443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007122-7e2e-4a1b-848f-361789a291d4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.825713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007122-7e2e-4a1b-848f-361789a291d4 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.828101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 198/385] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:29.834858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c2dc-16b4-4908-8a5b-caf94c600039 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.835143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c2dc-16b4-4908-8a5b-caf94c600039 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.835419 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c2dc-16b4-4908-8a5b-caf94c600039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.835862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934914b-63ac-445d-aa56-41dac6269d9f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:29.866550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4af6c2dc-16b4-4908-8a5b-caf94c600039 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:29.867741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4af6c2dc-16b4-4908-8a5b-caf94c600039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:29.870459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97074a-020a-4f88-b59f-3d94aebc604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:29.871366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97074a-020a-4f88-b59f-3d94aebc604e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:29.871657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97074a-020a-4f88-b59f-3d94aebc604e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:29.871902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97074a-020a-4f88-b59f-3d94aebc604e None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:29.873200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97074a-020a-4f88-b59f-3d94aebc604e None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:29.874682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97074a-020a-4f88-b59f-3d94aebc604e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:29.876642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 188/386] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:29 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:29.886367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97074a-020a-4f88-b59f-3d94aebc604e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:29.987509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97074a-020a-4f88-b59f-3d94aebc604e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:30.008239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 199/387] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:30.028667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262ad76-e077-4486-bef3-26170c45876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:30.029640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262ad76-e077-4486-bef3-26170c45876f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.029919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262ad76-e077-4486-bef3-26170c45876f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.030189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262ad76-e077-4486-bef3-26170c45876f None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.031406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262ad76-e077-4486-bef3-26170c45876f None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:30.032838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262ad76-e077-4486-bef3-26170c45876f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:30.034876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 189/388] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:29 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:30.039639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6c2dc-16b4-4908-8a5b-caf94c600039 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:30.044149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262ad76-e077-4486-bef3-26170c45876f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:30.199399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6c2dc-16b4-4908-8a5b-caf94c600039 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:30.231672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262ad76-e077-4486-bef3-26170c45876f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:30.241655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df9d9d-f4c0-4592-b81c-72478e0befeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:30.242461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df9d9d-f4c0-4592-b81c-72478e0befeb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.242734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df9d9d-f4c0-4592-b81c-72478e0befeb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.243002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df9d9d-f4c0-4592-b81c-72478e0befeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.255089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df9d9d-f4c0-4592-b81c-72478e0befeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-16df9d9d-f4c0-4592-b81c-72478e0befeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:30.263811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:30.264736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:30.265523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 200/389] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:30.271207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df9d9d-f4c0-4592-b81c-72478e0befeb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:30.302853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20be62-bcdb-42d9-af70-0853e94cb307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:30.304093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20be62-bcdb-42d9-af70-0853e94cb307 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.304610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20be62-bcdb-42d9-af70-0853e94cb307 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.305140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20be62-bcdb-42d9-af70-0853e94cb307 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a/groups/fda88656aff849899a0f2907ded1aa5f/roles/b2a32fa865d44fe48cd439137f78a12f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.311487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20be62-bcdb-42d9-af70-0853e94cb307 None admin] RBAC: Authorizing `identity:create_grant(project_id=0463b87212e547209f1edc8f93d9401a, group_id=fda88656aff849899a0f2907ded1aa5f, role_id=b2a32fa865d44fe48cd439137f78a12f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:30.313234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20be62-bcdb-42d9-af70-0853e94cb307 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:30.346308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 190/390] 10.222.0.58 () {58 vars in 1442 bytes} [Mon May 16 17:26:30 2022] PUT /identity/v3/projects/0463b87212e547209f1edc8f93d9401a/groups/fda88656aff849899a0f2907ded1aa5f/roles/b2a32fa865d44fe48cd439137f78a12f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:30.381476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df9d9d-f4c0-4592-b81c-72478e0befeb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:30.416783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:30.417457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.417761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.418032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.418773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:30.419071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:30.420512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:30.430117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 201/391] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:30.435893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20be62-bcdb-42d9-af70-0853e94cb307 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:30.571995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20be62-bcdb-42d9-af70-0853e94cb307 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:30.613076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f24e4-d663-496f-90aa-b36025f06d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:30.614342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f24e4-d663-496f-90aa-b36025f06d4c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.614834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f24e4-d663-496f-90aa-b36025f06d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.615303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f24e4-d663-496f-90aa-b36025f06d4c None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.616738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f24e4-d663-496f-90aa-b36025f06d4c None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:30.618441 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f24e4-d663-496f-90aa-b36025f06d4c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:30.620611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 191/392] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:30 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:30.629598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:30.742947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f77861-7ba7-4e3d-9ac5-433fea9c6bfc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:30.785714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa9efa-ea1c-47c7-aab6-72d2c52b1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:30.786967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9efa-ea1c-47c7-aab6-72d2c52b1185 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.787440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9efa-ea1c-47c7-aab6-72d2c52b1185 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.787902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9efa-ea1c-47c7-aab6-72d2c52b1185 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.789409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa9efa-ea1c-47c7-aab6-72d2c52b1185 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:30.791121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa9efa-ea1c-47c7-aab6-72d2c52b1185 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:30.793341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 202/393] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:30 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:30.798867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f24e4-d663-496f-90aa-b36025f06d4c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:30.919076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f24e4-d663-496f-90aa-b36025f06d4c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:30.959939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bb89-b37e-4628-8f4e-b0b7b49acb4d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.960481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bb89-b37e-4628-8f4e-b0b7b49acb4d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.960481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bb89-b37e-4628-8f4e-b0b7b49acb4d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.961867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 203/394] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:30.964705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13469ed-6c71-4b86-9383-c82137bac7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:30.965626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13469ed-6c71-4b86-9383-c82137bac7b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.965904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13469ed-6c71-4b86-9383-c82137bac7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.966174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13469ed-6c71-4b86-9383-c82137bac7b5 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a/groups/fda88656aff849899a0f2907ded1aa5f/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.970875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13469ed-6c71-4b86-9383-c82137bac7b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0463b87212e547209f1edc8f93d9401a, group_id=fda88656aff849899a0f2907ded1aa5f, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:30.972332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13469ed-6c71-4b86-9383-c82137bac7b5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:30.977467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d81ad-d205-4139-8330-dfd36e1f90eb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:30.977819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d81ad-d205-4139-8330-dfd36e1f90eb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:30.978097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d81ad-d205-4139-8330-dfd36e1f90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:30.989641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 192/395] 10.222.0.58 () {58 vars in 1442 bytes} [Mon May 16 17:26:30 2022] PUT /identity/v3/projects/0463b87212e547209f1edc8f93d9401a/groups/fda88656aff849899a0f2907ded1aa5f/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:31.010672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-066d81ad-d205-4139-8330-dfd36e1f90eb None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:31.011885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-066d81ad-d205-4139-8330-dfd36e1f90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:31.112968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 204/396] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:31.152774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13469ed-6c71-4b86-9383-c82137bac7b5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:31.274883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13469ed-6c71-4b86-9383-c82137bac7b5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:31.311262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e1cfe-16e8-4abe-82ce-38bfb458f4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:31.312392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e1cfe-16e8-4abe-82ce-38bfb458f4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:31.312815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e1cfe-16e8-4abe-82ce-38bfb458f4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:31.313224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e1cfe-16e8-4abe-82ce-38bfb458f4a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:31.324814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e1cfe-16e8-4abe-82ce-38bfb458f4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-af2e1cfe-16e8-4abe-82ce-38bfb458f4a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:31.332991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:31.334143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:31.335124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:31.337698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 193/397] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:31.343656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d81ad-d205-4139-8330-dfd36e1f90eb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:31.481167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d81ad-d205-4139-8330-dfd36e1f90eb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:31.524965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:31.525659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:31.525941 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:31.526210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:31.526961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:31.527262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:31.528643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:31.540526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 205/398] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:31.545996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e1cfe-16e8-4abe-82ce-38bfb458f4a1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:31.685387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e1cfe-16e8-4abe-82ce-38bfb458f4a1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:31.727564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e133b4-2103-4dcc-bc87-cc3d7f296135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:31.728443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e133b4-2103-4dcc-bc87-cc3d7f296135 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:31.728719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e133b4-2103-4dcc-bc87-cc3d7f296135 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:31.728991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e133b4-2103-4dcc-bc87-cc3d7f296135 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:31.730210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e133b4-2103-4dcc-bc87-cc3d7f296135 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:31.731715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e133b4-2103-4dcc-bc87-cc3d7f296135 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:31.733683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 194/399] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:31 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:31.739424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:31.896650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6397503-161e-46f9-9991-0253a1798fdd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:31.939734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91242e-f218-44ac-b345-52973d10bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:31.940601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91242e-f218-44ac-b345-52973d10bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:31.940874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91242e-f218-44ac-b345-52973d10bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:31.941144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91242e-f218-44ac-b345-52973d10bfa2 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:31.942348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91242e-f218-44ac-b345-52973d10bfa2 None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:31.943803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91242e-f218-44ac-b345-52973d10bfa2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:31.945825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 206/400] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:31 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:31.951992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e133b4-2103-4dcc-bc87-cc3d7f296135 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:31.969500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24d72-43c6-41c0-afd3-c07ffff35d26 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:31.970034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24d72-43c6-41c0-afd3-c07ffff35d26 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:31.970127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24d72-43c6-41c0-afd3-c07ffff35d26 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:31.971898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 207/401] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:31.976851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fbe81-1cf3-49a8-a013-07c54d6750b8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:31.977122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fbe81-1cf3-49a8-a013-07c54d6750b8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:31.977403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fbe81-1cf3-49a8-a013-07c54d6750b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:31.998650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1c3fbe81-1cf3-49a8-a013-07c54d6750b8 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:31.999843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1c3fbe81-1cf3-49a8-a013-07c54d6750b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:32.083812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 208/402] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:32.085809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85827d43-215d-45ae-a5a3-a65932e28747 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.086100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85827d43-215d-45ae-a5a3-a65932e28747 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.086375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85827d43-215d-45ae-a5a3-a65932e28747 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.087816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 209/403] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:32.094924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee434f90-cdd1-40fd-b926-41676469f5f0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.095206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee434f90-cdd1-40fd-b926-41676469f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.095481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee434f90-cdd1-40fd-b926-41676469f5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.106352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e133b4-2103-4dcc-bc87-cc3d7f296135 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:32.115631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ee434f90-cdd1-40fd-b926-41676469f5f0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:32.116796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ee434f90-cdd1-40fd-b926-41676469f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:32.152482 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a233b1-a12f-4443-93b6-f27cd24aad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:32.153775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a233b1-a12f-4443-93b6-f27cd24aad0c None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.154434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a233b1-a12f-4443-93b6-f27cd24aad0c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.155038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a233b1-a12f-4443-93b6-f27cd24aad0c None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00/groups/fda88656aff849899a0f2907ded1aa5f/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.159153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a233b1-a12f-4443-93b6-f27cd24aad0c None admin] RBAC: Authorizing `identity:create_grant(project_id=938f6968326342b59e88886f73e95b00, group_id=fda88656aff849899a0f2907ded1aa5f, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:32.161492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a233b1-a12f-4443-93b6-f27cd24aad0c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:32.186833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 195/404] 10.222.0.58 () {58 vars in 1442 bytes} [Mon May 16 17:26:31 2022] PUT /identity/v3/projects/938f6968326342b59e88886f73e95b00/groups/fda88656aff849899a0f2907ded1aa5f/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:32.187565 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a233b1-a12f-4443-93b6-f27cd24aad0c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:32.211264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 210/405] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:32.241375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee434f90-cdd1-40fd-b926-41676469f5f0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:32.385118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a233b1-a12f-4443-93b6-f27cd24aad0c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:32.395505 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee434f90-cdd1-40fd-b926-41676469f5f0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:32.438309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d7295-d30b-41ba-b023-d769cfd079e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:32.439192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f96fe-2257-43bb-8cf7-99118916a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:32.440286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f96fe-2257-43bb-8cf7-99118916a5af None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.441389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7295-d30b-41ba-b023-d769cfd079e5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.442048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7295-d30b-41ba-b023-d769cfd079e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.442514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7295-d30b-41ba-b023-d769cfd079e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.443693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f96fe-2257-43bb-8cf7-99118916a5af None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.444346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f96fe-2257-43bb-8cf7-99118916a5af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.466972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d7295-d30b-41ba-b023-d769cfd079e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:32.467902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f96fe-2257-43bb-8cf7-99118916a5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-cb2d7295-d30b-41ba-b023-d769cfd079e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:32.476097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:32.477054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:32.477976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e54f96fe-2257-43bb-8cf7-99118916a5af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:32.480268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:32.481148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:32.482083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 211/406] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:32.483776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 196/407] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:32.489519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d7295-d30b-41ba-b023-d769cfd079e5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:32.489698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f96fe-2257-43bb-8cf7-99118916a5af None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:32.611877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f96fe-2257-43bb-8cf7-99118916a5af None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:32.647829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:32.648418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.648694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.648963 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.650147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:32.650468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:32.651995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:32.661339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 212/408] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:32.667034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:32.677500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d7295-d30b-41ba-b023-d769cfd079e5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:32.763133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:32.763862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.764146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.764427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.765187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:32.765491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:32.766929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:32.772588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11df5-2ff0-42e9-a17b-cda4c65fabeb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:32.785111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 197/409] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:32.790653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:32.808206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a9bbe-c762-4fd4-b200-4053fa96d304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:32.809498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a9bbe-c762-4fd4-b200-4053fa96d304 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.809807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a9bbe-c762-4fd4-b200-4053fa96d304 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.810126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a9bbe-c762-4fd4-b200-4053fa96d304 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.811372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a9bbe-c762-4fd4-b200-4053fa96d304 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:32.812850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a9bbe-c762-4fd4-b200-4053fa96d304 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:32.814857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 213/410] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:32 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:32.821023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a9bbe-c762-4fd4-b200-4053fa96d304 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:32.929580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e69e4-3b89-4b7c-8d28-b2bd274f4109 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:32.970458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdda8fa-861f-4ffd-a1a9-fb767f43bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:32.971324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda8fa-861f-4ffd-a1a9-fb767f43bf39 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:32.971593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda8fa-861f-4ffd-a1a9-fb767f43bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:32.971861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda8fa-861f-4ffd-a1a9-fb767f43bf39 None admin] PATH_INFO: `/v3/groups/465441d5f3d14e4ca4b07c3061baab8d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:32.973125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda8fa-861f-4ffd-a1a9-fb767f43bf39 None admin] RBAC: Authorizing `identity:get_group(group_id=465441d5f3d14e4ca4b07c3061baab8d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:32.974684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda8fa-861f-4ffd-a1a9-fb767f43bf39 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:32.981586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 198/411] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:32 2022] GET /identity/v3/groups/465441d5f3d14e4ca4b07c3061baab8d => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:32.982199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdda8fa-861f-4ffd-a1a9-fb767f43bf39 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:33.027176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a9bbe-c762-4fd4-b200-4053fa96d304 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:33.118801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9f283-704a-4e74-a51d-e35ef1c5f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:33.120037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9f283-704a-4e74-a51d-e35ef1c5f27d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:33.120513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9f283-704a-4e74-a51d-e35ef1c5f27d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:33.120994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9f283-704a-4e74-a51d-e35ef1c5f27d None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:33.121720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdda8fa-861f-4ffd-a1a9-fb767f43bf39 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:33.123036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9f283-704a-4e74-a51d-e35ef1c5f27d None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:33.124708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9f283-704a-4e74-a51d-e35ef1c5f27d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:33.126973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 214/412] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:32 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:33.132129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9f283-704a-4e74-a51d-e35ef1c5f27d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:33.158035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532321b-1862-4e8a-80ce-91d3198ed5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:33.159118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532321b-1862-4e8a-80ce-91d3198ed5ee None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:33.159441 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532321b-1862-4e8a-80ce-91d3198ed5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:33.159717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532321b-1862-4e8a-80ce-91d3198ed5ee None admin] PATH_INFO: `/v3/projects/ab7c1a113cb54758aa563ff3298e430c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:33.161288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532321b-1862-4e8a-80ce-91d3198ed5ee None admin] RBAC: Authorizing `identity:get_project(project_id=ab7c1a113cb54758aa563ff3298e430c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:33.162977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532321b-1862-4e8a-80ce-91d3198ed5ee None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:33.165187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 199/413] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:32 2022] GET /identity/v3/projects/ab7c1a113cb54758aa563ff3298e430c => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:33.170662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532321b-1862-4e8a-80ce-91d3198ed5ee None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:33.281260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532321b-1862-4e8a-80ce-91d3198ed5ee None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:33.318154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b430b54-ab29-451f-a6c8-5cb2d3ad52ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:33.319768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b430b54-ab29-451f-a6c8-5cb2d3ad52ca None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:33.320236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b430b54-ab29-451f-a6c8-5cb2d3ad52ca None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:33.320692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b430b54-ab29-451f-a6c8-5cb2d3ad52ca None admin] PATH_INFO: `/v3/projects/ab7c1a113cb54758aa563ff3298e430c/groups/465441d5f3d14e4ca4b07c3061baab8d/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:33.323258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b430b54-ab29-451f-a6c8-5cb2d3ad52ca None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7c1a113cb54758aa563ff3298e430c, group_id=465441d5f3d14e4ca4b07c3061baab8d, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:33.324943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b430b54-ab29-451f-a6c8-5cb2d3ad52ca None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:33.343346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 200/414] 10.222.0.58 () {58 vars in 1442 bytes} [Mon May 16 17:26:33 2022] PUT /identity/v3/projects/ab7c1a113cb54758aa563ff3298e430c/groups/465441d5f3d14e4ca4b07c3061baab8d/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:33.363462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9f283-704a-4e74-a51d-e35ef1c5f27d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:33.435598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c2323-ed86-429d-bcfc-5a33c422a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:33.436609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2323-ed86-429d-bcfc-5a33c422a8e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:33.437007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2323-ed86-429d-bcfc-5a33c422a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:33.437291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2323-ed86-429d-bcfc-5a33c422a8e9 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00/groups/fda88656aff849899a0f2907ded1aa5f/roles/b2a32fa865d44fe48cd439137f78a12f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:33.443505 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c2323-ed86-429d-bcfc-5a33c422a8e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=938f6968326342b59e88886f73e95b00, group_id=fda88656aff849899a0f2907ded1aa5f, role_id=b2a32fa865d44fe48cd439137f78a12f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:33.444982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c2323-ed86-429d-bcfc-5a33c422a8e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:33.477904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 215/415] 10.222.0.58 () {58 vars in 1442 bytes} [Mon May 16 17:26:33 2022] PUT /identity/v3/projects/938f6968326342b59e88886f73e95b00/groups/fda88656aff849899a0f2907ded1aa5f/roles/b2a32fa865d44fe48cd439137f78a12f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:33.686208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554caf-9cce-4925-8c8b-f5c727db3d86 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:33.686489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554caf-9cce-4925-8c8b-f5c727db3d86 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:33.686765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554caf-9cce-4925-8c8b-f5c727db3d86 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:33.688527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 201/416] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:33.696047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3104-f3e0-4bd9-965c-cecbcb3f12e5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:33.696390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3104-f3e0-4bd9-965c-cecbcb3f12e5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:33.696604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3104-f3e0-4bd9-965c-cecbcb3f12e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:33.723655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-242e3104-f3e0-4bd9-965c-cecbcb3f12e5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:33.724886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-242e3104-f3e0-4bd9-965c-cecbcb3f12e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:33.802582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 216/417] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:33.837224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2554caf-9cce-4925-8c8b-f5c727db3d86 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:33.915900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985feb10-ffdc-43d7-8598-7f1173c5ec13 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:33.916249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985feb10-ffdc-43d7-8598-7f1173c5ec13 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:33.916445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985feb10-ffdc-43d7-8598-7f1173c5ec13 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:33.918073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 217/418] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:33.923291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0999d-4115-4d27-8c82-2a7b5b49faa4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:33.923561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0999d-4115-4d27-8c82-2a7b5b49faa4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:33.923844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0999d-4115-4d27-8c82-2a7b5b49faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:33.951933 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2554caf-9cce-4925-8c8b-f5c727db3d86 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:33.960760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-17e0999d-4115-4d27-8c82-2a7b5b49faa4 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:33.963786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-17e0999d-4115-4d27-8c82-2a7b5b49faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:34.011531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ecf8e-972b-4148-847e-a181705df3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:34.012698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ecf8e-972b-4148-847e-a181705df3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:34.013168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ecf8e-972b-4148-847e-a181705df3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:34.013715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ecf8e-972b-4148-847e-a181705df3d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:34.035743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ecf8e-972b-4148-847e-a181705df3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-904ecf8e-972b-4148-847e-a181705df3d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:34.045433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:34.046360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:34.047186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:34.052076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 202/419] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:34.059352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ecf8e-972b-4148-847e-a181705df3d9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:34.086375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 218/420] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:34.121923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0999d-4115-4d27-8c82-2a7b5b49faa4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:34.209892 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ecf8e-972b-4148-847e-a181705df3d9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:34.276450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:34.277120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:34.277396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:34.277693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:34.278445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:34.278745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:34.280183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:34.290578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 203/421] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:34.295958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:34.304557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0999d-4115-4d27-8c82-2a7b5b49faa4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:34.375229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32347ad6-bce9-47e3-a25e-63782405f55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:34.376442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347ad6-bce9-47e3-a25e-63782405f55f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:34.376910 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347ad6-bce9-47e3-a25e-63782405f55f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:34.377368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347ad6-bce9-47e3-a25e-63782405f55f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:34.392426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc82d1-518b-40ee-8bc5-3ffe056f87ed None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:34.406487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32347ad6-bce9-47e3-a25e-63782405f55f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-32347ad6-bce9-47e3-a25e-63782405f55f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:34.414409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:34.415309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:34.416104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 219/422] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:34.423233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32347ad6-bce9-47e3-a25e-63782405f55f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:34.428621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef9e4-3b31-4625-bb85-b1432710ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:34.429283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef9e4-3b31-4625-bb85-b1432710ff9a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:34.429792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef9e4-3b31-4625-bb85-b1432710ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:34.430070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef9e4-3b31-4625-bb85-b1432710ff9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:34.548415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acef9e4-3b31-4625-bb85-b1432710ff9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:34.551227 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acef9e4-3b31-4625-bb85-b1432710ff9a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:34.615959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32347ad6-bce9-47e3-a25e-63782405f55f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:34.672933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:34.673510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:34.673809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:34.674071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:34.674809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:34.675105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:34.676792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:34.695248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 220/423] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:34.703434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:34.739217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 204/424] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:34.744833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef9e4-3b31-4625-bb85-b1432710ff9a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:34.883216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4ca14-bb07-4117-8d69-7903000cad04 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:34.911746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef9e4-3b31-4625-bb85-b1432710ff9a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:34.933692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484acd3-3932-43eb-8961-952d287ec2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:34.934274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484acd3-3932-43eb-8961-952d287ec2ab None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:34.934561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484acd3-3932-43eb-8961-952d287ec2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:34.934814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484acd3-3932-43eb-8961-952d287ec2ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:34.947861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0954b-6b1d-402c-a018-27991ad169d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:34.949053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0954b-6b1d-402c-a018-27991ad169d0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:34.949594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0954b-6b1d-402c-a018-27991ad169d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:34.950104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0954b-6b1d-402c-a018-27991ad169d0 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:34.951752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0954b-6b1d-402c-a018-27991ad169d0 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:34.953393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0954b-6b1d-402c-a018-27991ad169d0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:34.955651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 205/425] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:34 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:34.957199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6648c-fd7b-4c1c-ae54-1408a6731688 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:34.957955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6648c-fd7b-4c1c-ae54-1408a6731688 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:34.958421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6648c-fd7b-4c1c-ae54-1408a6731688 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:34.959920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 206/426] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:34.960789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6648c-fd7b-4c1c-ae54-1408a6731688 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:35.005262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484acd3-3932-43eb-8961-952d287ec2ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:35.006743 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484acd3-3932-43eb-8961-952d287ec2ab None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:35.062845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6648c-fd7b-4c1c-ae54-1408a6731688 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:35.096401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a040e24-6a15-458f-9ff4-90a692be9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:35.097586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040e24-6a15-458f-9ff4-90a692be9ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.098130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040e24-6a15-458f-9ff4-90a692be9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.098407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040e24-6a15-458f-9ff4-90a692be9ef7 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.099957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a040e24-6a15-458f-9ff4-90a692be9ef7 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:35.101846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a040e24-6a15-458f-9ff4-90a692be9ef7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:35.105991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 221/428] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:35.107504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3477078-8890-4e96-be5f-43bb6c027857 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.107846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3477078-8890-4e96-be5f-43bb6c027857 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.108116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3477078-8890-4e96-be5f-43bb6c027857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.108951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 207/428] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:34 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:35.109943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a040e24-6a15-458f-9ff4-90a692be9ef7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:35.125130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c3477078-8890-4e96-be5f-43bb6c027857 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:35.126360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c3477078-8890-4e96-be5f-43bb6c027857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:35.194780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 222/429] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:35.195526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3477078-8890-4e96-be5f-43bb6c027857 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:35.221612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a040e24-6a15-458f-9ff4-90a692be9ef7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:35.260604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:35.261260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.261537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.261847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.263027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] RBAC: Adding query filter params (group.id=fda88656aff849899a0f2907ded1aa5f, role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=0463b87212e547209f1edc8f93d9401a) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:35.263396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:35.265161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:35.272812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 208/430] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:35 2022] GET /identity/v3/role_assignments?group.id=fda88656aff849899a0f2907ded1aa5f&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:35.277634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:35.386283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3477078-8890-4e96-be5f-43bb6c027857 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:35.446929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9a272-fdb6-4004-85a1-6019bfc612a6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:35.469291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67660723-c235-4dd7-b151-f94945eb7f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:35.470488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660723-c235-4dd7-b151-f94945eb7f14 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.470792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660723-c235-4dd7-b151-f94945eb7f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.471154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67660723-c235-4dd7-b151-f94945eb7f14 None admin] PATH_INFO: `/v3/projects/0463b87212e547209f1edc8f93d9401a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.472553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67660723-c235-4dd7-b151-f94945eb7f14 None admin] RBAC: Authorizing `identity:get_project(project_id=0463b87212e547209f1edc8f93d9401a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:35.474182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67660723-c235-4dd7-b151-f94945eb7f14 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:35.476237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 223/431] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:35 2022] GET /identity/v3/projects/0463b87212e547209f1edc8f93d9401a => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:35.482771 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67660723-c235-4dd7-b151-f94945eb7f14 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:35.491800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa63fe3-2faa-45a1-87be-2431aa2dde05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:35.491800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63fe3-2faa-45a1-87be-2431aa2dde05 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.492128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63fe3-2faa-45a1-87be-2431aa2dde05 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.492355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63fe3-2faa-45a1-87be-2431aa2dde05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.510995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa63fe3-2faa-45a1-87be-2431aa2dde05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-5fa63fe3-2faa-45a1-87be-2431aa2dde05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:35.521046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:35.522052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:35.522850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 209/432] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:35.528890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa63fe3-2faa-45a1-87be-2431aa2dde05 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:35.623526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67660723-c235-4dd7-b151-f94945eb7f14 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:35.649238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa63fe3-2faa-45a1-87be-2431aa2dde05 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:35.668077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1ebcd-9aaf-40d4-aa89-1c856b1a4a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:35.669274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ebcd-9aaf-40d4-aa89-1c856b1a4a54 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.669818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ebcd-9aaf-40d4-aa89-1c856b1a4a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.670284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ebcd-9aaf-40d4-aa89-1c856b1a4a54 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.671642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1ebcd-9aaf-40d4-aa89-1c856b1a4a54 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:35.673291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1ebcd-9aaf-40d4-aa89-1c856b1a4a54 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:35.677879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 224/433] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:35 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:35.683743 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1ebcd-9aaf-40d4-aa89-1c856b1a4a54 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:35.688483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:35.689307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.689604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.689934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.691551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:35.691860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:35.693764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:35.710829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 210/434] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:26:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:35.717657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:35.811253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1ebcd-9aaf-40d4-aa89-1c856b1a4a54 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:35.838123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3bf3-e5c4-4d07-86be-6f500e73cd89 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:35.853840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e720d-63c5-4f69-8f8a-cc56d104daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:35.854587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e720d-63c5-4f69-8f8a-cc56d104daca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.854876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e720d-63c5-4f69-8f8a-cc56d104daca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.856177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e720d-63c5-4f69-8f8a-cc56d104daca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.856794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e720d-63c5-4f69-8f8a-cc56d104daca None admin] RBAC: Adding query filter params (group.id=fda88656aff849899a0f2907ded1aa5f, role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=0463b87212e547209f1edc8f93d9401a) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:35.857134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e720d-63c5-4f69-8f8a-cc56d104daca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:35.858681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e720d-63c5-4f69-8f8a-cc56d104daca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:35.865007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 225/435] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:35 2022] GET /identity/v3/role_assignments?group.id=fda88656aff849899a0f2907ded1aa5f&scope.project.id=0463b87212e547209f1edc8f93d9401a&role.id=c9deaccdca814832a7d143419fd1d54f => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:35.882078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b7ce-739d-4124-b87f-6f9624df6511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:35.883032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b7ce-739d-4124-b87f-6f9624df6511 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:35.883481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b7ce-739d-4124-b87f-6f9624df6511 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:35.883893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b7ce-739d-4124-b87f-6f9624df6511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:35.963167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9b7ce-739d-4124-b87f-6f9624df6511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:35.964876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9b7ce-739d-4124-b87f-6f9624df6511 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:36.000444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915347c-0306-4dda-b108-190503e289aa None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.000728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915347c-0306-4dda-b108-190503e289aa None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.001003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915347c-0306-4dda-b108-190503e289aa None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.002690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 226/436] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:36.009940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52fa97-9836-40e2-b22f-77d4d29f78ed None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.010433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52fa97-9836-40e2-b22f-77d4d29f78ed None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.010806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52fa97-9836-40e2-b22f-77d4d29f78ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.032526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0a52fa97-9836-40e2-b22f-77d4d29f78ed None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:36.034452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0a52fa97-9836-40e2-b22f-77d4d29f78ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:36.074717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 211/437] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:36.080684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b7ce-739d-4124-b87f-6f9624df6511 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.116637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 227/438] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:36.118013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a8a17-a411-45a8-b5a3-4969d35a5a8e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.118299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a8a17-a411-45a8-b5a3-4969d35a5a8e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.118576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a8a17-a411-45a8-b5a3-4969d35a5a8e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.120065 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 228/439] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:36.125310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4b79-73a4-4a3b-9a16-43b8538f7472 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.125624 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4b79-73a4-4a3b-9a16-43b8538f7472 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.125899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4b79-73a4-4a3b-9a16-43b8538f7472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.144977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-503a4b79-73a4-4a3b-9a16-43b8538f7472 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:36.144977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-503a4b79-73a4-4a3b-9a16-43b8538f7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:36.201088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b7ce-739d-4124-b87f-6f9624df6511 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.219093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 229/440] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:36.219706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a4b79-73a4-4a3b-9a16-43b8538f7472 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.245070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4926c4-dab6-4129-92af-092e176a9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.245985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4926c4-dab6-4129-92af-092e176a9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.246256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4926c4-dab6-4129-92af-092e176a9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.246512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4926c4-dab6-4129-92af-092e176a9fd3 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.247836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4926c4-dab6-4129-92af-092e176a9fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:36.249162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4926c4-dab6-4129-92af-092e176a9fd3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:36.251238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 212/441] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:36.251622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4926c4-dab6-4129-92af-092e176a9fd3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.341664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a4b79-73a4-4a3b-9a16-43b8538f7472 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.357906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4926c4-dab6-4129-92af-092e176a9fd3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.379864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054a167-51ca-4dcb-9887-a67cf835817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.380622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a167-51ca-4dcb-9887-a67cf835817e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.380622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a167-51ca-4dcb-9887-a67cf835817e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.380838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a167-51ca-4dcb-9887-a67cf835817e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.392740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054a167-51ca-4dcb-9887-a67cf835817e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:36.399006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923521-ef71-464e-9f65-eea3944a8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.399809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923521-ef71-464e-9f65-eea3944a8b98 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.400089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923521-ef71-464e-9f65-eea3944a8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.400360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923521-ef71-464e-9f65-eea3944a8b98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9054a167-51ca-4dcb-9887-a67cf835817e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:36.400842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:36.402035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:36.402863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 230/442] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:36.403602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054a167-51ca-4dcb-9887-a67cf835817e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.413000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de923521-ef71-464e-9f65-eea3944a8b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-de923521-ef71-464e-9f65-eea3944a8b98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:36.420765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:36.421731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:36.422539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 213/443] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:36.423193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923521-ef71-464e-9f65-eea3944a8b98 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.502662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054a167-51ca-4dcb-9887-a67cf835817e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.518545 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923521-ef71-464e-9f65-eea3944a8b98 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.535281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a53f3f-e5b4-41c8-a48f-3849e3a4f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.536127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a53f3f-e5b4-41c8-a48f-3849e3a4f2de None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.536400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a53f3f-e5b4-41c8-a48f-3849e3a4f2de None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.536666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a53f3f-e5b4-41c8-a48f-3849e3a4f2de None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.537890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a53f3f-e5b4-41c8-a48f-3849e3a4f2de None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:36.539381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a53f3f-e5b4-41c8-a48f-3849e3a4f2de None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:36.540927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 231/444] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:36.541686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a53f3f-e5b4-41c8-a48f-3849e3a4f2de None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.553942 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.554608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.554887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.555242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.555994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:36.556297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:36.557672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:36.565760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 214/445] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:36.566518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.635569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a53f3f-e5b4-41c8-a48f-3849e3a4f2de None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.660840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca775a-3829-4a57-b457-5dd22b4e8f07 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.668071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.668727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.669001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.669239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.670066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:36.670361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:36.671687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:36.679636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 232/446] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:36.680390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.693948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.694681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.694964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.695240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.696070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] RBAC: Adding query filter params (group.id=fda88656aff849899a0f2907ded1aa5f, role.id=c9deaccdca814832a7d143419fd1d54f, scope.project.id=938f6968326342b59e88886f73e95b00) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:36.696379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:36.697820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:36.703545 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 215/447] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/role_assignments?group.id=fda88656aff849899a0f2907ded1aa5f&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=c9deaccdca814832a7d143419fd1d54f => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:36.704305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:36.787761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d26f-945f-46eb-ae57-1583d0796725 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.824781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802bd5f-fede-4951-9bde-4aeafcf5630b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:36.826080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae613ef1-94f2-4db1-90f6-bce9677f1605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.826843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae613ef1-94f2-4db1-90f6-bce9677f1605 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.827220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae613ef1-94f2-4db1-90f6-bce9677f1605 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.827582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae613ef1-94f2-4db1-90f6-bce9677f1605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.860546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715ec2f-237e-4e4e-8566-65806d1d0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:36.861379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715ec2f-237e-4e4e-8566-65806d1d0b59 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:36.861692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715ec2f-237e-4e4e-8566-65806d1d0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:36.861974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715ec2f-237e-4e4e-8566-65806d1d0b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:36.897140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae613ef1-94f2-4db1-90f6-bce9677f1605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:36.898794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae613ef1-94f2-4db1-90f6-bce9677f1605 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:36.940744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715ec2f-237e-4e4e-8566-65806d1d0b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:36.942280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715ec2f-237e-4e4e-8566-65806d1d0b59 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:37.007420 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 233/448] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:37.013111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae613ef1-94f2-4db1-90f6-bce9677f1605 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:37.052662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 216/449] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:37.058546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715ec2f-237e-4e4e-8566-65806d1d0b59 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:37.117805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae613ef1-94f2-4db1-90f6-bce9677f1605 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:37.151795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715ec2f-237e-4e4e-8566-65806d1d0b59 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:37.154426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ad84e-ce15-4833-8442-ca0d4cace343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:37.155330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad84e-ce15-4833-8442-ca0d4cace343 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:37.155611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad84e-ce15-4833-8442-ca0d4cace343 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:37.155880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad84e-ce15-4833-8442-ca0d4cace343 None admin] PATH_INFO: `/v3/projects/938f6968326342b59e88886f73e95b00` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:37.157143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ad84e-ce15-4833-8442-ca0d4cace343 None admin] RBAC: Authorizing `identity:get_project(project_id=938f6968326342b59e88886f73e95b00)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:37.158636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ad84e-ce15-4833-8442-ca0d4cace343 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:37.160363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 234/450] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:37 2022] GET /identity/v3/projects/938f6968326342b59e88886f73e95b00 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:37.165803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ad84e-ce15-4833-8442-ca0d4cace343 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:37.184335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a7153-6088-4695-b261-21262f6a8226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:37.185259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7153-6088-4695-b261-21262f6a8226 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:37.185535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7153-6088-4695-b261-21262f6a8226 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:37.185835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7153-6088-4695-b261-21262f6a8226 None admin] PATH_INFO: `/v3/projects/ab7c1a113cb54758aa563ff3298e430c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:37.187009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a7153-6088-4695-b261-21262f6a8226 None admin] RBAC: Authorizing `identity:get_project(project_id=ab7c1a113cb54758aa563ff3298e430c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:37.188435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a7153-6088-4695-b261-21262f6a8226 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:37.190129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 217/451] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:26:37 2022] GET /identity/v3/projects/ab7c1a113cb54758aa563ff3298e430c => generated 344 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:37.195404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a7153-6088-4695-b261-21262f6a8226 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:37.260042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ad84e-ce15-4833-8442-ca0d4cace343 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:37.287183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a7153-6088-4695-b261-21262f6a8226 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:37.293433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491a593-3232-4813-aa48-834a4c6e24a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:37.294328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a593-3232-4813-aa48-834a4c6e24a7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:37.294623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a593-3232-4813-aa48-834a4c6e24a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:37.294891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a593-3232-4813-aa48-834a4c6e24a7 None admin] PATH_INFO: `/v3/groups/fda88656aff849899a0f2907ded1aa5f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:37.296050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491a593-3232-4813-aa48-834a4c6e24a7 None admin] RBAC: Authorizing `identity:get_group(group_id=fda88656aff849899a0f2907ded1aa5f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:37.297488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491a593-3232-4813-aa48-834a4c6e24a7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:37.299145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 235/452] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:37 2022] GET /identity/v3/groups/fda88656aff849899a0f2907ded1aa5f => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:37.305323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491a593-3232-4813-aa48-834a4c6e24a7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:37.321022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845e54d-7f24-4db0-9808-0c67780293f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:37.321908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e54d-7f24-4db0-9808-0c67780293f5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:37.322184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e54d-7f24-4db0-9808-0c67780293f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:37.322446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e54d-7f24-4db0-9808-0c67780293f5 None admin] PATH_INFO: `/v3/groups/465441d5f3d14e4ca4b07c3061baab8d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:37.323657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845e54d-7f24-4db0-9808-0c67780293f5 None admin] RBAC: Authorizing `identity:get_group(group_id=465441d5f3d14e4ca4b07c3061baab8d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:37.325095 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845e54d-7f24-4db0-9808-0c67780293f5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:37.326828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 218/453] 10.222.0.58 () {56 vars in 1180 bytes} [Mon May 16 17:26:37 2022] GET /identity/v3/groups/465441d5f3d14e4ca4b07c3061baab8d => generated 229 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:37.332604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845e54d-7f24-4db0-9808-0c67780293f5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:37.399958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491a593-3232-4813-aa48-834a4c6e24a7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:37.426056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845e54d-7f24-4db0-9808-0c67780293f5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:37.432461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76425b41-1754-4eb2-8af1-7d484e1f1000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:37.433105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425b41-1754-4eb2-8af1-7d484e1f1000 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:37.433380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425b41-1754-4eb2-8af1-7d484e1f1000 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:37.433673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425b41-1754-4eb2-8af1-7d484e1f1000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:37.434485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76425b41-1754-4eb2-8af1-7d484e1f1000 None admin] RBAC: Adding query filter params (group.id=fda88656aff849899a0f2907ded1aa5f, role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=938f6968326342b59e88886f73e95b00) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:37.434787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76425b41-1754-4eb2-8af1-7d484e1f1000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:37.436252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76425b41-1754-4eb2-8af1-7d484e1f1000 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:37.442406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 236/454] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:37 2022] GET /identity/v3/role_assignments?group.id=fda88656aff849899a0f2907ded1aa5f&scope.project.id=938f6968326342b59e88886f73e95b00&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:37.459957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7299c9e-aba5-4899-bf39-feff0fb255a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:37.460632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7299c9e-aba5-4899-bf39-feff0fb255a1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:37.460903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7299c9e-aba5-4899-bf39-feff0fb255a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:37.461136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7299c9e-aba5-4899-bf39-feff0fb255a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:37.462055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7299c9e-aba5-4899-bf39-feff0fb255a1 None admin] RBAC: Adding query filter params (group.id=465441d5f3d14e4ca4b07c3061baab8d, role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=ab7c1a113cb54758aa563ff3298e430c) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:37.462359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7299c9e-aba5-4899-bf39-feff0fb255a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:37.463836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7299c9e-aba5-4899-bf39-feff0fb255a1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:37.470840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 219/455] 10.222.0.58 () {56 vars in 1376 bytes} [Mon May 16 17:26:37 2022] GET /identity/v3/role_assignments?group.id=465441d5f3d14e4ca4b07c3061baab8d&scope.project.id=ab7c1a113cb54758aa563ff3298e430c&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:40.259987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efb905-7da1-4ee5-82f8-cbb4c1035d26 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.260507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efb905-7da1-4ee5-82f8-cbb4c1035d26 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.260765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efb905-7da1-4ee5-82f8-cbb4c1035d26 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.262514 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 237/456] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:40.267778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964216e-46d2-4d2f-ae76-d43afe9f6078 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.268184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964216e-46d2-4d2f-ae76-d43afe9f6078 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.268419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964216e-46d2-4d2f-ae76-d43afe9f6078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.294618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4964216e-46d2-4d2f-ae76-d43afe9f6078 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:40.295861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4964216e-46d2-4d2f-ae76-d43afe9f6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:40.384467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 220/457] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:40.435250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efb905-7da1-4ee5-82f8-cbb4c1035d26 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:40.524371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594f08-cb66-4a55-a82d-3517e337e867 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.524731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594f08-cb66-4a55-a82d-3517e337e867 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.524920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594f08-cb66-4a55-a82d-3517e337e867 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.526696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 221/458] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:40.540791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c0fe-293a-46ef-ab5b-f447b9ee67f1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.541098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c0fe-293a-46ef-ab5b-f447b9ee67f1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.541329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c0fe-293a-46ef-ab5b-f447b9ee67f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.559098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efb905-7da1-4ee5-82f8-cbb4c1035d26 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:40.574582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8302c0fe-293a-46ef-ab5b-f447b9ee67f1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:40.575875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8302c0fe-293a-46ef-ab5b-f447b9ee67f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:40.595408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:40.596564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.597033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.597492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.608702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:40.610456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:40.629325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:40.630265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:40.631122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:40.631122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:40.631122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:40.631122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:40.637642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 238/459] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:40.640508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:40.736417 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 222/460] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:40.740088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c477d9-c4a1-4bd2-ac57-f09ea67dbea0 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.740376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c477d9-c4a1-4bd2-ac57-f09ea67dbea0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.740644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c477d9-c4a1-4bd2-ac57-f09ea67dbea0 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.742203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 223/461] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:40.747029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349937-e0ca-4124-a641-def83894b643 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.747310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349937-e0ca-4124-a641-def83894b643 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.747626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349937-e0ca-4124-a641-def83894b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.776459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3a349937-e0ca-4124-a641-def83894b643 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:40.777538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3a349937-e0ca-4124-a641-def83894b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:40.786857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3ef23-3de2-4d6c-9207-e8e2aac5ac16 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:40.830555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:40.831851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.832348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.832937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.834454 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:40.834979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:40.837262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:40.849656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 224/462] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:40.854895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349937-e0ca-4124-a641-def83894b643 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:40.855298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 239/463] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:40.856699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:40.952477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05ae94-25c3-4795-8c99-869781c3eb3d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:40.959972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349937-e0ca-4124-a641-def83894b643 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:40.984273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270966-5627-45e0-bc22-57c4f76adc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:40.985057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270966-5627-45e0-bc22-57c4f76adc2b None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.985435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270966-5627-45e0-bc22-57c4f76adc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.985740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270966-5627-45e0-bc22-57c4f76adc2b None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:40.986439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9270966-5627-45e0-bc22-57c4f76adc2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:40.987874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9270966-5627-45e0-bc22-57c4f76adc2b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:40.991544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea654-2bf0-41b4-b79d-aa0299cb90b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:40.992329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea654-2bf0-41b4-b79d-aa0299cb90b8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:40.992603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea654-2bf0-41b4-b79d-aa0299cb90b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:40.992899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea654-2bf0-41b4-b79d-aa0299cb90b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.003555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea654-2bf0-41b4-b79d-aa0299cb90b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.005136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea654-2bf0-41b4-b79d-aa0299cb90b8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.008549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 240/464] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:40 2022] POST /identity/v3/users => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:26:41.015241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aac0b-0a23-4c29-a827-b13b3aeb5031 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.015532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aac0b-0a23-4c29-a827-b13b3aeb5031 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.015805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aac0b-0a23-4c29-a827-b13b3aeb5031 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.021656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 241/465] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:41.021656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aac0b-0a23-4c29-a827-b13b3aeb5031 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-9d9ea654-2bf0-41b4-b79d-aa0299cb90b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:41.031712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:41.032787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:41.033789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:41.033789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:41.033789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:41.033789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:41.036010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 225/466] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:41.037767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dfb62-9da3-49b9-9bf7-b1d58a8d6336 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.038184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dfb62-9da3-49b9-9bf7-b1d58a8d6336 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.038588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dfb62-9da3-49b9-9bf7-b1d58a8d6336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.057334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1d9dfb62-9da3-49b9-9bf7-b1d58a8d6336 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:41.058858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1d9dfb62-9da3-49b9-9bf7-b1d58a8d6336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:41.130519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 226/467] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:41.138875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dfb62-9da3-49b9-9bf7-b1d58a8d6336 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:41.153718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aac0b-0a23-4c29-a827-b13b3aeb5031 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:41.190879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:41.191854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.192486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.192770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.205542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.207163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:41.225467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:41.226418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:41.227992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:41.227992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:41.227992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:41.227992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:41.227992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 242/468] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:41.227992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:41.280920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dfb62-9da3-49b9-9bf7-b1d58a8d6336 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:41.319069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:41.320075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.320648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.321111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.322070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:41.322583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.324221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.332055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47152c52-cc63-430d-b88d-3364f68b3bfc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:41.341405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 227/469] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:41.342579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:41.365855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:41.366665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.366921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.367189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.378725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.380200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:41.397274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:41.398290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:41.399142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:41.399142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:41.399142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:41.399142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:41.399142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 243/470] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:41.399410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:41.448144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac82f2b-41ce-48c9-afdb-60ed477114f7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:41.482722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:41.483751 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.484223 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.484682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.485630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:41.486123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.487690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.500311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 228/471] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:41.501496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:41.506077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37be69a-aebf-40ab-9b10-7238aa34af6c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:41.539408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c79ef-663b-428d-b597-6a36cc6dd629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:41.540091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c79ef-663b-428d-b597-6a36cc6dd629 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.540370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c79ef-663b-428d-b597-6a36cc6dd629 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.540642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c79ef-663b-428d-b597-6a36cc6dd629 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.541726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c79ef-663b-428d-b597-6a36cc6dd629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.542876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c79ef-663b-428d-b597-6a36cc6dd629 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.577662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 244/472] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:41 2022] POST /identity/v3/users => generated 248 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:41.577662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c79ef-663b-428d-b597-6a36cc6dd629 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:41.640032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf5b31-2edb-44b1-94d9-f5e601240e02 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:41.716455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:41.717144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.717467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.717765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.718497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:41.718799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.720196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.740698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 229/473] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:41.746369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:41.789210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c79ef-663b-428d-b597-6a36cc6dd629 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:41.824984 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c30e4-747f-4645-a95d-d068358b89f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:41.826238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c30e4-747f-4645-a95d-d068358b89f3 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.826743 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c30e4-747f-4645-a95d-d068358b89f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.827235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c30e4-747f-4645-a95d-d068358b89f3 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.828206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c30e4-747f-4645-a95d-d068358b89f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.831007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c30e4-747f-4645-a95d-d068358b89f3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.850519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 245/474] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:41 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:41.857575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6f779-5f9b-4e87-9ec0-35970accc175 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.858393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6f779-5f9b-4e87-9ec0-35970accc175 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.858678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6f779-5f9b-4e87-9ec0-35970accc175 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.860174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 246/475] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:41.864678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0184af-c57e-442b-bab5-257a10b85756 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:41.866949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551af4b5-3b14-496a-9cd6-4005348283c1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.867236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551af4b5-3b14-496a-9cd6-4005348283c1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.867511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551af4b5-3b14-496a-9cd6-4005348283c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.910597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-551af4b5-3b14-496a-9cd6-4005348283c1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:41.911809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-551af4b5-3b14-496a-9cd6-4005348283c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:41.912885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4615067-a716-41bd-b02e-00e5906e4c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:41.913617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4615067-a716-41bd-b02e-00e5906e4c2e None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:41.914136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4615067-a716-41bd-b02e-00e5906e4c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:41.914425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4615067-a716-41bd-b02e-00e5906e4c2e None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:41.916201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4615067-a716-41bd-b02e-00e5906e4c2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:41.917783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4615067-a716-41bd-b02e-00e5906e4c2e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:41.946605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 230/476] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:41 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:41.996606 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 247/477] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:42.039542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4615067-a716-41bd-b02e-00e5906e4c2e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:42.166356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4615067-a716-41bd-b02e-00e5906e4c2e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:42.203358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:42.203358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:42.203358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:42.203358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:42.203790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:42.205052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:42.216226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.sql.core [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 17:26:42.216226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 17:26:42.216226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [parameters: {'id': '9eef5f6f7fc340758c1fa5edca8c696f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 17:26:42.216226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80038) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = self._query(query) May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application conn.query(q) May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result.read() May 16 17:26:42.232413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return ref.to_dict() May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 17:26:42.233292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application next(self.gen) May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application yield resource May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application next(self.gen) May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.session.rollback() May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.force_reraise() May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise self.value May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application session.commit() May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 17:26:42.234239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._prepare_impl() May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.session.flush() May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._flush(objects) May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application compat.raise_( May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application flush_context.execute() May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rec.execute(self) May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 17:26:42.235125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 17:26:42.236014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = self._query(query) May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application conn.query(q) May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result.read() May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 17:26:42.236811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [parameters: {'id': '9eef5f6f7fc340758c1fa5edca8c696f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:42.238679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 17:26:42.240625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:42.242537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 231/478] 10.222.0.58 () {60 vars in 1131 bytes} [Mon May 16 17:26:42 2022] POST /identity/v3/roles => generated 144 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:42.242810 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551af4b5-3b14-496a-9cd6-4005348283c1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:42.352909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551af4b5-3b14-496a-9cd6-4005348283c1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:42.395209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b47d39-05b3-4d13-97ee-ce5e2e66662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:42.396027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b47d39-05b3-4d13-97ee-ce5e2e66662d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:42.396302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b47d39-05b3-4d13-97ee-ce5e2e66662d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:42.396571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b47d39-05b3-4d13-97ee-ce5e2e66662d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:42.410563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b47d39-05b3-4d13-97ee-ce5e2e66662d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-31b47d39-05b3-4d13-97ee-ce5e2e66662d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:42.419414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:42.420269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:42.421056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 248/479] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:26:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:42.426977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:42.574943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac018010-0899-438a-95a5-7828c0e03fe9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:42.623790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c176edf-6e0b-4dc5-ae56-72e729ec48b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:42.624470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c176edf-6e0b-4dc5-ae56-72e729ec48b2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:42.624744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c176edf-6e0b-4dc5-ae56-72e729ec48b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:42.625013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c176edf-6e0b-4dc5-ae56-72e729ec48b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:42.625786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c176edf-6e0b-4dc5-ae56-72e729ec48b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:42.626086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c176edf-6e0b-4dc5-ae56-72e729ec48b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:42.627463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c176edf-6e0b-4dc5-ae56-72e729ec48b2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:42.641011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 232/480] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:43.570338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02adc-ef2a-48c3-80a2-064b10adda16 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:43.570852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02adc-ef2a-48c3-80a2-064b10adda16 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:43.570956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02adc-ef2a-48c3-80a2-064b10adda16 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:43.572265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 249/481] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:43.578530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5c28c-e034-480f-bb10-be3934064b34 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:43.578953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5c28c-e034-480f-bb10-be3934064b34 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:43.579122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5c28c-e034-480f-bb10-be3934064b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:43.606567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6dd5c28c-e034-480f-bb10-be3934064b34 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:43.607812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6dd5c28c-e034-480f-bb10-be3934064b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:43.692562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 233/482] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:43.731039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee02adc-ef2a-48c3-80a2-064b10adda16 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:43.863990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee02adc-ef2a-48c3-80a2-064b10adda16 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:43.896480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44dc8-2aab-4e17-9946-f22e3d77c118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:43.897329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44dc8-2aab-4e17-9946-f22e3d77c118 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:43.897630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44dc8-2aab-4e17-9946-f22e3d77c118 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:43.897903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44dc8-2aab-4e17-9946-f22e3d77c118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:43.907918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac44dc8-2aab-4e17-9946-f22e3d77c118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bac44dc8-2aab-4e17-9946-f22e3d77c118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:43.915604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:43.916486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:43.917276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 250/483] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:43.922811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5c28c-e034-480f-bb10-be3934064b34 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:44.072981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5c28c-e034-480f-bb10-be3934064b34 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:44.111846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34675a8c-c2a4-4ff3-a2b4-11109366e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:44.112528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34675a8c-c2a4-4ff3-a2b4-11109366e5fb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.112803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34675a8c-c2a4-4ff3-a2b4-11109366e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.113073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34675a8c-c2a4-4ff3-a2b4-11109366e5fb None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.113852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34675a8c-c2a4-4ff3-a2b4-11109366e5fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:44.114208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34675a8c-c2a4-4ff3-a2b4-11109366e5fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:44.115539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34675a8c-c2a4-4ff3-a2b4-11109366e5fb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:44.125087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 234/484] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:44.130423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44dc8-2aab-4e17-9946-f22e3d77c118 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:44.268527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44dc8-2aab-4e17-9946-f22e3d77c118 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:44.319190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:44.320031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.320397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.320666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.333344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5b823-9ba6-4cbb-b6f9-4f506e183840 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.333665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5b823-9ba6-4cbb-b6f9-4f506e183840 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.333947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5b823-9ba6-4cbb-b6f9-4f506e183840 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.336351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:44.336762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 235/485] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:44.337927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:44.340947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668085-8713-4fc0-a8bc-ea9b16f8952f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.341276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668085-8713-4fc0-a8bc-ea9b16f8952f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.341572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668085-8713-4fc0-a8bc-ea9b16f8952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:44.366693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:44.367609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:44.368469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:44.368469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:44.368469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:44.368469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:44.368469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 251/486] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:44.373317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2a668085-8713-4fc0-a8bc-ea9b16f8952f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:44.374542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2a668085-8713-4fc0-a8bc-ea9b16f8952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:44.377355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:44.515265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 236/487] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:44.533261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110ae1d-e5a2-4676-a40b-f55ae31e5d05 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:44.571290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:44.571941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a668085-8713-4fc0-a8bc-ea9b16f8952f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:44.572064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.572304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.573631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.573631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:44.573631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:44.575312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:44.601763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 252/488] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:44.606793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:44.719569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e806a84-5baf-4e24-aa4f-9286b0bed55e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:44.730694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a668085-8713-4fc0-a8bc-ea9b16f8952f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:44.753935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:44.754778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.755055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.755327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.763046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:44.765063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:44.777652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d7b9-b77a-49bf-b7a7-27e075e6f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:44.778536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d7b9-b77a-49bf-b7a7-27e075e6f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.779029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d7b9-b77a-49bf-b7a7-27e075e6f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.779306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d7b9-b77a-49bf-b7a7-27e075e6f0b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:44.794985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:44.795916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:26:44.796819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:44.797331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4d7b9-b77a-49bf-b7a7-27e075e6f0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:44.799499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 253/489] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:26:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-6ba4d7b9-b77a-49bf-b7a7-27e075e6f0b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:44.808142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:44.809020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:44.809994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 237/490] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:44.811108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:44.816828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d7b9-b77a-49bf-b7a7-27e075e6f0b5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:44.912193 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b7fd2-334d-4941-afd7-88b629d18bbf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:44.914338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d7b9-b77a-49bf-b7a7-27e075e6f0b5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:44.946020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ab14-b61f-40c3-b040-9e7c125f0c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:44.946696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ab14-b61f-40c3-b040-9e7c125f0c25 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.946971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1c173-a73d-4f8b-b7e4-e3efbd117d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:44.947085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ab14-b61f-40c3-b040-9e7c125f0c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.947256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ab14-b61f-40c3-b040-9e7c125f0c25 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.947666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1c173-a73d-4f8b-b7e4-e3efbd117d99 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.947947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1c173-a73d-4f8b-b7e4-e3efbd117d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.948130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ab14-b61f-40c3-b040-9e7c125f0c25 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:44.948220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1c173-a73d-4f8b-b7e4-e3efbd117d99 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.948407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ab14-b61f-40c3-b040-9e7c125f0c25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:44.948974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1c173-a73d-4f8b-b7e4-e3efbd117d99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:44.949275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1c173-a73d-4f8b-b7e4-e3efbd117d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:44.949893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ab14-b61f-40c3-b040-9e7c125f0c25 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:44.950746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1c173-a73d-4f8b-b7e4-e3efbd117d99 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:44.963556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 238/491] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:44.963556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66838d27-c040-4c8b-b813-71fbe9744fc4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.963556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66838d27-c040-4c8b-b813-71fbe9744fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.963556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66838d27-c040-4c8b-b813-71fbe9744fc4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.963556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 239/492] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:44.963556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da059-981e-476b-930a-327e12a8c0be None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.963556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da059-981e-476b-930a-327e12a8c0be None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.964086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da059-981e-476b-930a-327e12a8c0be None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:44.965178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 240/493] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:44.969819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da059-981e-476b-930a-327e12a8c0be None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:44.992670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 254/494] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:26:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:44.994068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0cbeb-685f-40db-a994-d4aa0dffbba1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:44.994352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0cbeb-685f-40db-a994-d4aa0dffbba1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:44.994626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0cbeb-685f-40db-a994-d4aa0dffbba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.019434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-32d0cbeb-685f-40db-a994-d4aa0dffbba1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:45.021159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-32d0cbeb-685f-40db-a994-d4aa0dffbba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:45.076793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da059-981e-476b-930a-327e12a8c0be None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.094676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 255/495] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:45.096087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5361-f76c-4072-9a2d-5e729b1f1e14 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.096380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5361-f76c-4072-9a2d-5e729b1f1e14 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.096653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5361-f76c-4072-9a2d-5e729b1f1e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.116514 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-77ca5361-f76c-4072-9a2d-5e729b1f1e14 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:45.117859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-77ca5361-f76c-4072-9a2d-5e729b1f1e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:45.118762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.120079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.121476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.121925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.135493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:45.137151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:45.158557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:45.159504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:45.160358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:45.160358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:45.160358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:45.160358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:45.160358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 241/496] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:45.160626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.187210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 256/497] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:45.188108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5361-f76c-4072-9a2d-5e729b1f1e14 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.284606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469e70-bdc4-4b4b-a82f-2cc7d3a4778b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.284981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5361-f76c-4072-9a2d-5e729b1f1e14 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.320729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cbf8d-a0e8-4b54-82c5-70133c7c87a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.321558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cbf8d-a0e8-4b54-82c5-70133c7c87a8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.321843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cbf8d-a0e8-4b54-82c5-70133c7c87a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.322167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cbf8d-a0e8-4b54-82c5-70133c7c87a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.326288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba77e-4974-4532-a57a-0bf9efe1d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.326921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba77e-4974-4532-a57a-0bf9efe1d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.327219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba77e-4974-4532-a57a-0bf9efe1d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.327473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba77e-4974-4532-a57a-0bf9efe1d6a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.333055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cbf8d-a0e8-4b54-82c5-70133c7c87a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-df2cbf8d-a0e8-4b54-82c5-70133c7c87a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:45.340956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:45.342040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:45.343057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:45.345489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 257/498] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:45.346325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cbf8d-a0e8-4b54-82c5-70133c7c87a8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.403508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beba77e-4974-4532-a57a-0bf9efe1d6a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:45.405086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beba77e-4974-4532-a57a-0bf9efe1d6a3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:45.452444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cbf8d-a0e8-4b54-82c5-70133c7c87a8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.484221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.484887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.485166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.485438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.486194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:45.486499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:45.487895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:45.499306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 258/499] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:45.499306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.510645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 242/500] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:45.510645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba77e-4974-4532-a57a-0bf9efe1d6a3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.598599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f60ac-e760-4536-b0da-45fa7763a58b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.614821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba77e-4974-4532-a57a-0bf9efe1d6a3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.631738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a61ed-6f97-498f-b1ed-80f0cbddabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.632547 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a61ed-6f97-498f-b1ed-80f0cbddabfb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.632831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a61ed-6f97-498f-b1ed-80f0cbddabfb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.633104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a61ed-6f97-498f-b1ed-80f0cbddabfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.646552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a61ed-6f97-498f-b1ed-80f0cbddabfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:45.648294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.648294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.648294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.648530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.649218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:45.649517 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:45.650899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3d3a61ed-6f97-498f-b1ed-80f0cbddabfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:45.654970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:45.655906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:45.656710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:45.658459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 259/501] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:45.659997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a61ed-6f97-498f-b1ed-80f0cbddabfb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.664687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 243/502] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:45.665788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.760956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a61ed-6f97-498f-b1ed-80f0cbddabfb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.764009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9799-de0c-45a5-9607-e945c190da47 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.792537 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.793391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.793698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.793973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.797814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.798683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.798948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.799212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.804291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:45.805852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:45.810737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:45.812228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:45.820284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:45.821341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:45.822320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 260/503] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:45.822902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:45.833743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:45.834691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:45.835556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:45.835556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:45.835556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:45.835556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:45.835556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 244/504] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:45.835847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.924526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cafa1-6312-4f14-979e-f99e38ebf156 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.931082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667f4be-711a-43c0-8b54-6b104d3436bf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:45.962025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721c7df-89a5-4f61-b36e-e21d96b6b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.962694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721c7df-89a5-4f61-b36e-e21d96b6b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.962970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721c7df-89a5-4f61-b36e-e21d96b6b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.963252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721c7df-89a5-4f61-b36e-e21d96b6b3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.963992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721c7df-89a5-4f61-b36e-e21d96b6b3b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:45.964296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721c7df-89a5-4f61-b36e-e21d96b6b3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:45.965696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721c7df-89a5-4f61-b36e-e21d96b6b3b8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:45.966165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:45.966991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.967257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.967525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.973573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 261/505] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:45.974855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e80f-cc5b-4067-a2ec-3ad7c4aad30a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:45.975140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e80f-cc5b-4067-a2ec-3ad7c4aad30a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:45.975414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e80f-cc5b-4067-a2ec-3ad7c4aad30a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:45.976778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 262/506] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:45.977378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e80f-cc5b-4067-a2ec-3ad7c4aad30a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:45.978160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:45.979434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:45.997100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:45.998186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:45.999069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:45.999069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:45.999069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:45.999069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:45.999069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 245/507] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:45.999354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.082430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e80f-cc5b-4067-a2ec-3ad7c4aad30a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.095389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0ef6-e0fd-4e83-b673-8cab675e68fb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.118576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.119291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.119553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.119830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.120702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:46.121021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.122599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.130386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae2aee-4758-4de9-92bf-3c857d55de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.131078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae2aee-4758-4de9-92bf-3c857d55de54 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.131354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae2aee-4758-4de9-92bf-3c857d55de54 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.131625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae2aee-4758-4de9-92bf-3c857d55de54 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.132375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae2aee-4758-4de9-92bf-3c857d55de54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:46.132657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae2aee-4758-4de9-92bf-3c857d55de54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.134109 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae2aee-4758-4de9-92bf-3c857d55de54 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.139953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 263/508] 10.222.0.58 () {56 vars in 1137 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:46.140761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.150711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 246/509] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:46.152048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5019eb-46f3-4bf6-90df-86982dac5f30 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.152339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5019eb-46f3-4bf6-90df-86982dac5f30 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.152628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5019eb-46f3-4bf6-90df-86982dac5f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.168920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1c5019eb-46f3-4bf6-90df-86982dac5f30 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:46.170173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1c5019eb-46f3-4bf6-90df-86982dac5f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:46.234189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 247/510] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:46.245707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5019eb-46f3-4bf6-90df-86982dac5f30 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.245814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062015a3-85d5-4250-a2ed-7d1dc4dce454 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.271914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.272730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.273004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.273273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.283459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.284917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:46.301900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:46.302804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:46.303649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:46.303649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:46.303649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:46.303649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:46.303649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 264/511] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:46.303907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.329062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5019eb-46f3-4bf6-90df-86982dac5f30 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.363967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.364690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.364970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.365246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.366044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:46.366336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.367777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.379593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 248/512] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:46.380406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.407104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db1f9-dcff-48fa-a6cb-8afeadf406b6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.440197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7c92-03b4-42c4-a34e-61a822fcc332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.440834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7c92-03b4-42c4-a34e-61a822fcc332 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.441109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7c92-03b4-42c4-a34e-61a822fcc332 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.441377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7c92-03b4-42c4-a34e-61a822fcc332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.478093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26673943-bdb5-4575-8f50-8fe2ff373581 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.504289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca7c92-03b4-42c4-a34e-61a822fcc332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.505798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca7c92-03b4-42c4-a34e-61a822fcc332 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.513135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.514037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.514307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.514575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.521337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.522794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:46.536966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:46.537862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:46.538728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 249/513] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:46.539193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.603244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 265/514] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:46.604098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7c92-03b4-42c4-a34e-61a822fcc332 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.638399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c5d39-73f5-408f-ad99-0be35f1dc280 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.674697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.675471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.675743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.676011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.686184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.687732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.698177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7c92-03b4-42c4-a34e-61a822fcc332 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:46.705149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:46.706151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:46.706978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:46.706978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:46.706978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:46.706978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:46.706978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 250/515] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:46.707244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.732676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.733270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.733584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.733850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.734572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:46.734875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.736274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.747044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 266/516] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:46.747809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.818375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02326327-5183-48fb-abdb-8aa82be47465 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.846502 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b9b9-d254-4c88-8a48-214d8e29a829 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:46.853289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.854039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.854317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.854596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.863515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.864953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.879143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834028-733d-49f8-91eb-811136163308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:46.879816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834028-733d-49f8-91eb-811136163308 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:46.880096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834028-733d-49f8-91eb-811136163308 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:46.880369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834028-733d-49f8-91eb-811136163308 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:46.880538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:46.881364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 17:26:46.882316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:46.882826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d834028-733d-49f8-91eb-811136163308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:46.882826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d834028-733d-49f8-91eb-811136163308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:46.882946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 251/517] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:46.882946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.883070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d834028-733d-49f8-91eb-811136163308 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:46.901601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 267/518] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:46.901851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834028-733d-49f8-91eb-811136163308 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:46.991609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5924a6-5923-4a8c-9430-4959b45bd83e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.008961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834028-733d-49f8-91eb-811136163308 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.027867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.028851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.029131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.029413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.040529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.042113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.045667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.046376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.046697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.046973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.047714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:47.048024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.049468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:47.061033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:47.061968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:47.067902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:47.067902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:47.067902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:47.067902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:47.068193 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 268/519] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:47.068288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 252/520] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:47.068288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.068451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.165735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0648571-29be-45d7-895d-7df95a8a84c1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.168098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11a5b9-86c9-477d-a735-010094067d49 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.200301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.200476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.201035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.201215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.201307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.201500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.201612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.201790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.202469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:47.202777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.204257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.210517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.212012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:47.226185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:47.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 269/521] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:47.228247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.249400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 253/522] 10.222.0.58 () {56 vars in 1137 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:47.249400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.325669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40ac61-9c2a-4ef6-a8c2-e322e647e3bd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.345724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845ceeb-1204-4902-b06c-1043c9f89857 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.363233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.363878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.364154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.364418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.365224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=a7263b80be2c437997b1a18002c9969d) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:47.365525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.367021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.372426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 270/523] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/role_assignments?user.id=a7263b80be2c437997b1a18002c9969d&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:47.373171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.395073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab8b0a-fefa-4abb-8839-54090dfab7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.395768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8b0a-fefa-4abb-8839-54090dfab7cc None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.396058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8b0a-fefa-4abb-8839-54090dfab7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.396332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8b0a-fefa-4abb-8839-54090dfab7cc None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.397057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab8b0a-fefa-4abb-8839-54090dfab7cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.398581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab8b0a-fefa-4abb-8839-54090dfab7cc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.420734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 254/524] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:26:47 2022] POST /identity/v3/users => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:47.421341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab8b0a-fefa-4abb-8839-54090dfab7cc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.505183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd1bff-045f-487e-ab4e-aafb474b5db9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.544625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.545517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.545863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.546172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.546757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab8b0a-fefa-4abb-8839-54090dfab7cc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.547171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:47.547510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.549675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.568347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 271/525] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:47.569495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.591076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.592338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.592839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.593355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.594537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:47.595133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.596927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.623272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 255/526] 10.222.0.58 () {56 vars in 1139 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:47.624700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.687645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf140de-a07b-4173-81a9-3f786b7dabbb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.726846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2c507-cc40-480a-b553-51527a361230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.727499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2c507-cc40-480a-b553-51527a361230 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.727776 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2c507-cc40-480a-b553-51527a361230 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.728170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2c507-cc40-480a-b553-51527a361230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.749259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3706a-1361-49ec-8c0b-80c3446d54b2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.784940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.785687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.785962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.786226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:47.793130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.794656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.797413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2c507-cc40-480a-b553-51527a361230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:47.798894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2c507-cc40-480a-b553-51527a361230 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:47.809534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:47.810516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:47.811359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:47.811359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:47.811359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:47.811359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:47.811359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:47.811359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:47.811359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:47.811359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:47.811768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 256/527] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:47.813191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.903742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 272/528] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:47.904684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2c507-cc40-480a-b553-51527a361230 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:47.915898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1095b7a-0d80-401c-b6eb-8e2ed57b067e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:47.949792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997e57c-bd3b-488c-9986-4ff492626eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:47.950661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997e57c-bd3b-488c-9986-4ff492626eab None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:47.950943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997e57c-bd3b-488c-9986-4ff492626eab None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:47.951216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997e57c-bd3b-488c-9986-4ff492626eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.000781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2c507-cc40-480a-b553-51527a361230 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.019491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997e57c-bd3b-488c-9986-4ff492626eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.020961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997e57c-bd3b-488c-9986-4ff492626eab None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.036414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.036990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.037267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.037541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.038341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:48.038637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.040088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.052943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 273/529] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:48.053901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.129068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 257/530] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:48.130049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997e57c-bd3b-488c-9986-4ff492626eab None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.156253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa422-1d94-4ef1-bd1c-2684a193a226 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.190588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.191414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.191688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.191956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.203297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.206879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:48.224393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:48.225497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:48.226462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:48.226462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:48.226462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:48.226462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:48.228022 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 274/531] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:48.229043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.233134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997e57c-bd3b-488c-9986-4ff492626eab None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.268757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.269458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.269777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.270115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.271108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=0a0ca8aafef94f3399c92a91f5bff1ef) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:48.271809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.272924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.279088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 258/532] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/role_assignments?user.id=0a0ca8aafef94f3399c92a91f5bff1ef&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:48.279776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.335928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de277-e69d-43a1-a7b5-495083e5c52e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.372382 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.373646 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.374127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.374642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.391552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41118d93-1da9-4b6f-81f7-7c67f95d7311 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.400862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.402860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.430039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.430753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.431080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.431355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.432152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:48.432450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.433914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:48.445579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:48.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:48.447467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:48.447467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:48.447467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:48.447467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:48.447931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 259/533] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:48.449990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 275/534] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:48.456477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.456674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.560951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19359e94-f883-4fcd-a8f4-22a285eb4f64 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.594801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.595812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.596313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.596770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.597747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:48.598252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.599847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.617020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 276/535] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:48.618597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.641728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf8d6-f22a-475e-8113-9abee535c123 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.677399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.678280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.678559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.678828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.685894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.687773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:48.702194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:48.703081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:48.704082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 260/536] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:48.711749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.722983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd57c3-e6be-418b-a0aa-b5476f10f556 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.756840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.758095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.758567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.759030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.766240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.768006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:48.782809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:48.783750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:48.784618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:48.784618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:48.784618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:48.784618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:48.784618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:48.784618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:48.784618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:48.784618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:48.791511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 277/537] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:48.792907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.871910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625bf1-9fe8-4857-b729-48789d2a0eec None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:48.905772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:48.906445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:48.906794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:48.906977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:48.907758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:48.908058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:48.909500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:48.928251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 261/538] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:48.933640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:48.939697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e22c7-50e7-41a8-b481-ae5fc55d6920 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:49.010276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:49.010952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:49.011234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:49.011509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:49.012309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:49.012617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:49.014185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:49.035844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 278/539] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:49.036139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be5105-a174-4180-9dd8-d7377087fcb3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:49.041786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:49.106556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a69297-f3b3-4f51-872d-784aa480f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:49.107211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69297-f3b3-4f51-872d-784aa480f839 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:49.107490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69297-f3b3-4f51-872d-784aa480f839 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:49.107760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69297-f3b3-4f51-872d-784aa480f839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:49.108596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a69297-f3b3-4f51-872d-784aa480f839 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=43278916b971416e80a79077cf0da75d) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:49.108899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a69297-f3b3-4f51-872d-784aa480f839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:49.110368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a69297-f3b3-4f51-872d-784aa480f839 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:49.119215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 262/540] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:48 2022] GET /identity/v3/role_assignments?user.id=43278916b971416e80a79077cf0da75d&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:49.204739 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68dec-69c4-4072-9409-df9c844f1196 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:49.264738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abde29-88b8-4887-b008-3903e19154cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:49.265414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abde29-88b8-4887-b008-3903e19154cd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:49.265723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abde29-88b8-4887-b008-3903e19154cd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:49.266002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abde29-88b8-4887-b008-3903e19154cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:49.266845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abde29-88b8-4887-b008-3903e19154cd None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=2fddf039f65a4cff95c9c2041dd81ef6) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:49.267154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abde29-88b8-4887-b008-3903e19154cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:49.268598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abde29-88b8-4887-b008-3903e19154cd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:49.278181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 279/541] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:49 2022] GET /identity/v3/role_assignments?user.id=2fddf039f65a4cff95c9c2041dd81ef6&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:49.909184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935c2b-a1b5-416d-b603-39ffc216b12f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:49.909463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935c2b-a1b5-416d-b603-39ffc216b12f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:49.909921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935c2b-a1b5-416d-b603-39ffc216b12f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:49.911795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 263/542] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:49.918057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b99707-d7ac-468a-8f03-37665632814f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:49.918968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b99707-d7ac-468a-8f03-37665632814f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:49.919412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b99707-d7ac-468a-8f03-37665632814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:49.942290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d2b99707-d7ac-468a-8f03-37665632814f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:49.943738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d2b99707-d7ac-468a-8f03-37665632814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:50.012004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 280/543] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:50.034579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3935c2b-a1b5-416d-b603-39ffc216b12f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:50.178323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3935c2b-a1b5-416d-b603-39ffc216b12f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:50.213349 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a12e-102d-4f37-9ac6-6e38d9f187d5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:50.213988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a12e-102d-4f37-9ac6-6e38d9f187d5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:50.214459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22a12e-102d-4f37-9ac6-6e38d9f187d5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:50.216356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 281/544] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:50.221513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99acbf-b3a6-477a-93f6-37cbec73c2c2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:50.222024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99acbf-b3a6-477a-93f6-37cbec73c2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:50.222249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb79b-62f6-454c-8ab3-5db469581611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:50.222723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99acbf-b3a6-477a-93f6-37cbec73c2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:50.223071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb79b-62f6-454c-8ab3-5db469581611 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:50.223356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb79b-62f6-454c-8ab3-5db469581611 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:50.223634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb79b-62f6-454c-8ab3-5db469581611 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:50.238482 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb79b-62f6-454c-8ab3-5db469581611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:50.240965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9b99acbf-b3a6-477a-93f6-37cbec73c2c2 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:50.242461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9b99acbf-b3a6-477a-93f6-37cbec73c2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-239eb79b-62f6-454c-8ab3-5db469581611 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:50.246419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:50.247396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:50.248179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:50.254094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 264/545] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:50.259788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb79b-62f6-454c-8ab3-5db469581611 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:50.337777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 282/546] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:50.376554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99acbf-b3a6-477a-93f6-37cbec73c2c2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:50.422475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb79b-62f6-454c-8ab3-5db469581611 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:50.460535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:50.461575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:50.462071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:50.462698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:50.464173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:50.465466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:50.467847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:50.482935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 265/547] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:50.489792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:50.589127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99acbf-b3a6-477a-93f6-37cbec73c2c2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:50.606323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd79d4-8fc2-4751-85a8-7592c1aa06d0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:50.643264 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:50.644070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:50.644354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:50.644624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:50.662687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b196-e532-4aef-9b65-3d14fabdda93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:50.663488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b196-e532-4aef-9b65-3d14fabdda93 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:50.663771 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b196-e532-4aef-9b65-3d14fabdda93 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:50.664042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b196-e532-4aef-9b65-3d14fabdda93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:50.665275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:50.666862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:50.681791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99b196-e532-4aef-9b65-3d14fabdda93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2b99b196-e532-4aef-9b65-3d14fabdda93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:50.690951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:50.691844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:50.692698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:50.697879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 283/548] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:50.707405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:50.708245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:50.709146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:50.709146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:50.709146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:50.709146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:50.714585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b196-e532-4aef-9b65-3d14fabdda93 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:50.715405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 266/549] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:50.716275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:50.873518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b196-e532-4aef-9b65-3d14fabdda93 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:50.916192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ac9d5-bf83-419d-95fc-6132e17b849e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:50.922394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:50.923206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:50.923570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:50.923937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:50.924783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:50.925155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:50.927014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:50.945718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 284/550] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:50.951011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:50.962382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:50.963108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:50.963391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:50.963664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:50.964389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:50.964744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:50.966220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:50.979039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 267/551] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:50.984442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.106813 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28471e3-8f4a-44ff-8e9b-922d6cdff124 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.148329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafca2b0-3a24-487d-ad6b-b574d4ae9e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.149747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafca2b0-3a24-487d-ad6b-b574d4ae9e3b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.150187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafca2b0-3a24-487d-ad6b-b574d4ae9e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.150768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafca2b0-3a24-487d-ad6b-b574d4ae9e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.151080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5bab-5dd9-4101-98ae-75dc0d9d3f50 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.169642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafca2b0-3a24-487d-ad6b-b574d4ae9e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.171350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafca2b0-3a24-487d-ad6b-b574d4ae9e3b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.185322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.186231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.186573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.186907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-aafca2b0-3a24-487d-ad6b-b574d4ae9e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:51.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:51.194163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:51.195222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:51.195222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:51.195222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:51.195222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:51.196245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.197310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 285/552] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:51.198689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853b07-6062-499b-8a26-bda549494418 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.199110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853b07-6062-499b-8a26-bda549494418 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.199529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853b07-6062-499b-8a26-bda549494418 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.201199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 286/553] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:51.206559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3446c3-9f8d-4fd9-9e37-2bb22564dfd2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.207591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3446c3-9f8d-4fd9-9e37-2bb22564dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.207723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.208124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3446c3-9f8d-4fd9-9e37-2bb22564dfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:51.223692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:51.224821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:26:51.225857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:51.227383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 268/554] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:26:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:51.228337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.231676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3c3446c3-9f8d-4fd9-9e37-2bb22564dfd2 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:51.232841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3c3446c3-9f8d-4fd9-9e37-2bb22564dfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:51.309103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 287/555] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:51.310329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3446c3-9f8d-4fd9-9e37-2bb22564dfd2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.358059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6ac92-7083-48c8-ad8a-c0cd7362bab6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.391454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.392352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.392770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.393178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.394087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:51.394526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.396034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.407868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 269/556] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:51.408957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.425019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3446c3-9f8d-4fd9-9e37-2bb22564dfd2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.466202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.467217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.467676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.468168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.469232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:51.469768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.471406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.489980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 288/557] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:51.491100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.536167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7242e2-a4ba-495f-9ecf-c99682460bba None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.570647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf2091-9974-4490-af9d-48eeed37e886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.571871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf2091-9974-4490-af9d-48eeed37e886 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.572439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf2091-9974-4490-af9d-48eeed37e886 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.572904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf2091-9974-4490-af9d-48eeed37e886 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.583684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf2091-9974-4490-af9d-48eeed37e886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8cbf2091-9974-4490-af9d-48eeed37e886 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:51.591926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:51.592808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:51.593722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:51.600888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 270/558] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:51.601984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf2091-9974-4490-af9d-48eeed37e886 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.607490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6aa6-d745-4cf4-aa51-d9696a2e59e0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.644075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.644871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.645157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.645430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.652450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.654094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:51.669480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:51.670416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:51.671284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 289/559] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:51.672465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.705183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf2091-9974-4490-af9d-48eeed37e886 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.741622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e04be-3ec8-4b53-bd7d-9a7321119585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.742837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e04be-3ec8-4b53-bd7d-9a7321119585 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.743195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e04be-3ec8-4b53-bd7d-9a7321119585 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.743610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e04be-3ec8-4b53-bd7d-9a7321119585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.758727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e04be-3ec8-4b53-bd7d-9a7321119585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.760258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e04be-3ec8-4b53-bd7d-9a7321119585 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-842e04be-3ec8-4b53-bd7d-9a7321119585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:51.778337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:51.779266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:51.780601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:51.780601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:51.780601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:51.780601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:51.780824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0642f4-6855-4db8-8d3c-5fc47892d2b0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.780897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 271/560] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:51.781523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a2d36-2dd5-436e-975a-023c56f30de8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.781523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a2d36-2dd5-436e-975a-023c56f30de8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.781707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a2d36-2dd5-436e-975a-023c56f30de8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.785680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 272/561] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:51.785680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a2d36-2dd5-436e-975a-023c56f30de8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.820664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.821335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.821641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.821915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.822660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:51.822957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.824331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.832253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 290/562] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:51.833048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:51.895096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a2d36-2dd5-436e-975a-023c56f30de8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.927914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319aca1-52e4-47c3-b365-06a03a38241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.928587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319aca1-52e4-47c3-b365-06a03a38241e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.928863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319aca1-52e4-47c3-b365-06a03a38241e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.929132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319aca1-52e4-47c3-b365-06a03a38241e None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.930004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319aca1-52e4-47c3-b365-06a03a38241e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:51.930309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319aca1-52e4-47c3-b365-06a03a38241e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.931747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319aca1-52e4-47c3-b365-06a03a38241e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.940665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9732f-b64e-4b35-853d-854fff2dd81e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:51.948520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 273/563] 10.222.0.58 () {56 vars in 1135 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:51.950021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0cd7-dd28-47a7-b8e6-e8f6972e57d1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.950503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0cd7-dd28-47a7-b8e6-e8f6972e57d1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.950774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0cd7-dd28-47a7-b8e6-e8f6972e57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.966051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-872e0cd7-dd28-47a7-b8e6-e8f6972e57d1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:51.967206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-872e0cd7-dd28-47a7-b8e6-e8f6972e57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:51.972021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:51.972674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:51.972950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:51.973220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:51.973976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:51.974271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:51.975620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:51.986938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 291/564] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:51.987692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.028528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 274/565] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:52.030131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4243-3f7f-4f7a-b3f8-f2044498f142 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.030420 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4243-3f7f-4f7a-b3f8-f2044498f142 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.030689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4243-3f7f-4f7a-b3f8-f2044498f142 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.033722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 275/566] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:52.033722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4243-3f7f-4f7a-b3f8-f2044498f142 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.082986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790fbdb-760f-4481-9107-b6e972f217ef None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.115115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.115936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.116197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.116470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.126432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.127937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:52.129072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4243-3f7f-4f7a-b3f8-f2044498f142 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:52.145206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:52.146146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:52.147106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:52.147106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:52.147106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:52.147106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:52.149701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 292/567] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:52.150677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.160984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678940b3-bd46-431f-80f0-920858579a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.161654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678940b3-bd46-431f-80f0-920858579a0a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.161928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678940b3-bd46-431f-80f0-920858579a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.162194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678940b3-bd46-431f-80f0-920858579a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.225796 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678940b3-bd46-431f-80f0-920858579a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.227246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678940b3-bd46-431f-80f0-920858579a0a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:52.242976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dde9cc-619e-4bec-8736-a1f3a6e17bc4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.274772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40392a98-beaa-41c5-9b31-fe6b5d68810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.275557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40392a98-beaa-41c5-9b31-fe6b5d68810a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.275834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40392a98-beaa-41c5-9b31-fe6b5d68810a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.276106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40392a98-beaa-41c5-9b31-fe6b5d68810a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.282709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40392a98-beaa-41c5-9b31-fe6b5d68810a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.284094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40392a98-beaa-41c5-9b31-fe6b5d68810a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-40392a98-beaa-41c5-9b31-fe6b5d68810a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:52.297426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:52.298292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:52.299234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:52.299234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:52.299234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:52.299234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:52.299234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:52.299234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:52.299234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:52.299234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:52.301987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 293/568] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:52.302998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e9e7-9938-4440-b619-baffaf10252c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.303258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e9e7-9938-4440-b619-baffaf10252c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.303552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e9e7-9938-4440-b619-baffaf10252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.320014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 276/569] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:52.320185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0aa9e9e7-9938-4440-b619-baffaf10252c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:52.320835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678940b3-bd46-431f-80f0-920858579a0a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.321228 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0aa9e9e7-9938-4440-b619-baffaf10252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:52.385989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 294/570] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:52.386792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9e9e7-9938-4440-b619-baffaf10252c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.420390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678940b3-bd46-431f-80f0-920858579a0a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.451463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ba38-41e5-4b19-b3c2-0e395e7f0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.452238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ba38-41e5-4b19-b3c2-0e395e7f0462 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.452482 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ba38-41e5-4b19-b3c2-0e395e7f0462 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.452767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ba38-41e5-4b19-b3c2-0e395e7f0462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.462505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2ba38-41e5-4b19-b3c2-0e395e7f0462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-09a2ba38-41e5-4b19-b3c2-0e395e7f0462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:52.470202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:52.471144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:52.471984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 277/571] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:52.473186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ba38-41e5-4b19-b3c2-0e395e7f0462 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.495039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9e9e7-9938-4440-b619-baffaf10252c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.528340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.528997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.529265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.529525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.530282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:52.530582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.531968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:52.543225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 295/572] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:52.543996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.573023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ba38-41e5-4b19-b3c2-0e395e7f0462 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.606180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.606868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.607153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.607429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.608210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:52.608515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.609959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:52.621777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 278/573] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:52.622582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.639039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07865-cd26-4d55-8f12-58baa2ebfd23 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.671519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.672302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.672588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.672861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.683477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.684987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:52.701806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:52.702756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:52.703668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:52.703668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:52.703668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:52.703668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:52.703668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 296/574] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:52.703939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.725625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94607a52-1ebd-40c9-9daf-c42422b3adbf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.757570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15c4a4-2807-4596-bfb7-9a5d27c45c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.758363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c4a4-2807-4596-bfb7-9a5d27c45c55 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.758645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c4a4-2807-4596-bfb7-9a5d27c45c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.758914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c4a4-2807-4596-bfb7-9a5d27c45c55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.769164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15c4a4-2807-4596-bfb7-9a5d27c45c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8d15c4a4-2807-4596-bfb7-9a5d27c45c55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:52.776789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:52.777799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:52.778706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 279/575] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:52.779516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15c4a4-2807-4596-bfb7-9a5d27c45c55 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.801988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24b37-961c-4e21-8181-ed74da45364b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.833648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.834309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.834592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.834865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.835607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:52.835917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.837291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:52.844979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 297/576] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:52.845763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.875035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15c4a4-2807-4596-bfb7-9a5d27c45c55 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.910167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.910958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.911226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.911487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.919067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.920522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:52.934733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:52.935703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 280/577] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:52.936640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:52.940610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8dcde-16c8-4fad-b2f0-72767d4299a9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:52.972986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268efc0-f8e6-45cc-a280-4635cc85ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:52.973887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268efc0-f8e6-45cc-a280-4635cc85ebc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:52.974163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268efc0-f8e6-45cc-a280-4635cc85ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:52.974433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268efc0-f8e6-45cc-a280-4635cc85ebc3 None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/a7263b80be2c437997b1a18002c9969d/roles/117a8af4218c4823b9f45e58df8c8be1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:52.988187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268efc0-f8e6-45cc-a280-4635cc85ebc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=a7263b80be2c437997b1a18002c9969d, role_id=117a8af4218c4823b9f45e58df8c8be1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:52.989656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268efc0-f8e6-45cc-a280-4635cc85ebc3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.002688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 298/578] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:52 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/a7263b80be2c437997b1a18002c9969d/roles/117a8af4218c4823b9f45e58df8c8be1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:53.003442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268efc0-f8e6-45cc-a280-4635cc85ebc3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.034176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803315e0-077c-4d63-9d50-6414bd76a721 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.068776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.069423 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.069729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.069996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.070727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:53.071033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.072462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.085387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 281/579] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:53.086735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.123266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268efc0-f8e6-45cc-a280-4635cc85ebc3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.164126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.164816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.165095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.165372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.166169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:53.166477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.167918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.177471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 299/580] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:53.178652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.201454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a641-99c3-4385-a11f-22164fc41731 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.238276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.239314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.239760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.240025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.249763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.251201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:53.267971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:53.268897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:53.269819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:53.269819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:53.269819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:53.269819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:53.269819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 282/581] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:53.270108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.284431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46c4d1-df99-4c29-b895-a83075d15a61 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.319465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.320052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.320367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.320593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.321426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:53.321751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.323173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.340133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 300/582] 10.222.0.58 () {56 vars in 1137 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:53.341053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.379657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7377b5-a0f5-4866-a193-6acf20fb2b96 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.413204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.414041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.414310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.414573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.421104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.422570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:53.436001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:53.436919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:53.437829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 283/583] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:53.438338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.448485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449afebf-a099-4152-aa05-174feb59e88e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.482503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.483361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.483669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.483991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.493817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.495292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:53.512449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:53.513462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:53.515132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:53.515132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:53.515132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:53.515132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:53.515132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 301/584] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:53.515132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.544874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7f67-06f1-4980-8b11-ee774ab81ead None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.577301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.577924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.578203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.578653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.579187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:53.579494 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.580869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.592134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 284/585] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:53.592921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.623787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e35b4-ce83-42bf-bdf1-43a426420cd2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.656344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.657159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.657436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.657738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.667653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.669484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:53.687346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:53.688269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:53.693697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:53.693697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:53.693697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:53.693697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:53.693945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce09a-b98f-4f11-aeac-90d4a6ed16ab None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.694024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 302/586] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:53.694024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.727858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.728521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.728798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.729065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.729878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:53.730180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.731648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.747726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 285/587] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:53.747726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.792379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167ddad-1ef6-4183-9b1a-c608e406a348 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.824889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.825898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.826174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.826446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.827167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:53.827517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.828836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.844530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 303/588] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:53.844530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.850363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb87a1-5261-4f8e-955b-a3b332e209c6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.886529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.887389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.887706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.888036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.895823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.897259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:53.912008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:53.913306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 17:26:53.914335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:53.918006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 286/589] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:53.918623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:53.940436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41f8d5-156f-4c06-9422-39490feab843 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:53.974167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:53.974889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:53.975110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:53.975384 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:53.976105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:53.976409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:53.977811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:53.989321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 304/590] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:53.990124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.015035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a14085-c30a-4db6-a3e4-2027b3ba747a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.046384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.047031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.047301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.047564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.048383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=6f320795fd0b42319df94dbc171938b8) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:54.048679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.050127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.065896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 287/591] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/role_assignments?user.id=6f320795fd0b42319df94dbc171938b8&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:54.065896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.088084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0155-e5c0-413a-a59c-70d8239ca78a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.126126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.126944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.127218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.127487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.135615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.137187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:54.157871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:54.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 17:26:54.159838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:54.164225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 305/592] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:54.165492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.177219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb0379-a971-42b1-8f33-e4b118c2ea49 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.217058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.217949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.218090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.218450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.219238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:54.219548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.221006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.245055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 288/593] 10.222.0.58 () {56 vars in 1137 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:54.246040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.271171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a072-74f3-4149-bb2e-edf42a544cff None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.311756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.312844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.313127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.313403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.324158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.325808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:54.344564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:54.345479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:54.346391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:54.346391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:54.346391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:54.346391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:54.346391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:54.346391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:54.346391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:54.346391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:54.346896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 306/594] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:54.347552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.361077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90eabd-7164-4ce0-93ea-491c716c965e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.402781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.404169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.404463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.404728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.405793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:54.406103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.408061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.430145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 289/595] 10.222.0.58 () {56 vars in 1139 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:54.431642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.458627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8725-9aef-4ead-93f3-c93561b516de None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.495941 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.497282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.497871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.498349 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.513500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.515872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:54.535586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:54.536523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:54.537386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:54.537386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:54.537386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:54.537386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:54.542168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 307/596] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:54.543593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.577284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2046-819a-4db0-b49e-373e5cdde413 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.613498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.614129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.614408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.614680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.615549 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:54.615828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.617370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.629429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 290/597] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:54.630572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.674466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b91570-a0c9-401a-8bdd-780f00fa8794 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.717111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.718689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.719542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.720454 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.735740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.738383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.739615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc295e47-3327-40e5-96a3-38719b04c94d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:54.759355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:54.760336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:54.761236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:54.761236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:54.761236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:54.761236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:54.765291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 308/598] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:54.766186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.784138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.785566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.786021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.786476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.787377 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:54.787863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.789390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.802656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 291/599] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:54.803739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.883090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1d1a-0e02-4ad4-81bb-a3de93ae3e08 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.919334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60440e-c6b5-4a4d-8a01-70c78ad3633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.920724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60440e-c6b5-4a4d-8a01-70c78ad3633a None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.921171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60440e-c6b5-4a4d-8a01-70c78ad3633a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.921817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60440e-c6b5-4a4d-8a01-70c78ad3633a None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/0a0ca8aafef94f3399c92a91f5bff1ef/roles/117a8af4218c4823b9f45e58df8c8be1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.937427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ebe9b-c772-44cd-b752-9541d6e92de1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:54.939704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60440e-c6b5-4a4d-8a01-70c78ad3633a None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=0a0ca8aafef94f3399c92a91f5bff1ef, role_id=117a8af4218c4823b9f45e58df8c8be1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.941346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60440e-c6b5-4a4d-8a01-70c78ad3633a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.957825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 309/600] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:54 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/0a0ca8aafef94f3399c92a91f5bff1ef/roles/117a8af4218c4823b9f45e58df8c8be1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:54.959119 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60440e-c6b5-4a4d-8a01-70c78ad3633a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:54.974908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:54.975726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:54.975947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:54.976217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:54.977036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:54.977337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:54.978874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:54.994822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 292/601] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:55.000630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:55.073572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60440e-c6b5-4a4d-8a01-70c78ad3633a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:55.112806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:55.114515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.115180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.115661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.118456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e1f2-b850-4083-bc20-7a16cf03ecd4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:55.123937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:55.125679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:55.141008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:55.141987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:55.142860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:55.142860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:55.142860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:55.142860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:55.142860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:55.142860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:55.142860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:55.142860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:55.145715 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 310/602] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:55.152626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:55.163332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:55.164590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.165924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.166415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.176759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:55.179566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:55.198771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:55.199786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:55.200682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:55.200682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:55.200682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:55.200682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:55.200682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:55.200682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:55.200682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:55.200682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:55.203379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 293/603] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:55.215332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:55.312781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443609a2-3aa4-4a36-a505-762d94f2ad6e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:55.358220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3665cb-c88e-4cf8-857b-b9982074c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:55.358896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3665cb-c88e-4cf8-857b-b9982074c810 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.359178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3665cb-c88e-4cf8-857b-b9982074c810 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.359450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3665cb-c88e-4cf8-857b-b9982074c810 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.360257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3665cb-c88e-4cf8-857b-b9982074c810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:55.360572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3665cb-c88e-4cf8-857b-b9982074c810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:55.360670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119150-69b7-422c-87c0-227aa8eb2bda None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:55.362146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3665cb-c88e-4cf8-857b-b9982074c810 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:55.379810 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 311/604] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:26:55.381392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ed0c-e84f-41fe-9219-503b0d013d44 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.381719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ed0c-e84f-41fe-9219-503b0d013d44 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.381992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ed0c-e84f-41fe-9219-503b0d013d44 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.383615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 312/605] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:55.390531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ed0c-e84f-41fe-9219-503b0d013d44 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:55.407032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb573-b87f-4cb7-97e3-77e026732e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:55.407727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb573-b87f-4cb7-97e3-77e026732e52 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.408158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb573-b87f-4cb7-97e3-77e026732e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.408440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb573-b87f-4cb7-97e3-77e026732e52 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.409528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cb573-b87f-4cb7-97e3-77e026732e52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:55.409860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cb573-b87f-4cb7-97e3-77e026732e52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:55.411313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cb573-b87f-4cb7-97e3-77e026732e52 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:55.428106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 294/606] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:55.429464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d254d-0a19-4ecb-8236-af5c99ff8845 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.429786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d254d-0a19-4ecb-8236-af5c99ff8845 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.430067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d254d-0a19-4ecb-8236-af5c99ff8845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.452261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e02d254d-0a19-4ecb-8236-af5c99ff8845 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:55.453751 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e02d254d-0a19-4ecb-8236-af5c99ff8845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:55.504726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ed0c-e84f-41fe-9219-503b0d013d44 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:55.537691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 295/607] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:55.538810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d254d-0a19-4ecb-8236-af5c99ff8845 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:55.545057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c876-f1e7-4cac-99ae-3565edc17e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:55.546112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c876-f1e7-4cac-99ae-3565edc17e2d None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.546396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c876-f1e7-4cac-99ae-3565edc17e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.546678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c876-f1e7-4cac-99ae-3565edc17e2d None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/43278916b971416e80a79077cf0da75d/roles/117a8af4218c4823b9f45e58df8c8be1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.564111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6c876-f1e7-4cac-99ae-3565edc17e2d None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=43278916b971416e80a79077cf0da75d, role_id=117a8af4218c4823b9f45e58df8c8be1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:55.565998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6c876-f1e7-4cac-99ae-3565edc17e2d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:55.587903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 313/608] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:55 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/43278916b971416e80a79077cf0da75d/roles/117a8af4218c4823b9f45e58df8c8be1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:55.588289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c876-f1e7-4cac-99ae-3565edc17e2d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:55.702569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d254d-0a19-4ecb-8236-af5c99ff8845 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:55.729286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c876-f1e7-4cac-99ae-3565edc17e2d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:55.769086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb55b16-decc-4edb-aca9-1683fcf8c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:55.770058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb55b16-decc-4edb-aca9-1683fcf8c1ff None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.770338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb55b16-decc-4edb-aca9-1683fcf8c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.770610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb55b16-decc-4edb-aca9-1683fcf8c1ff None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/2fddf039f65a4cff95c9c2041dd81ef6/roles/117a8af4218c4823b9f45e58df8c8be1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.783821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a23234-0d4f-47a6-bc6c-bed384fbb45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:55.784918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23234-0d4f-47a6-bc6c-bed384fbb45e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.785195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23234-0d4f-47a6-bc6c-bed384fbb45e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.785646 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23234-0d4f-47a6-bc6c-bed384fbb45e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.789886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb55b16-decc-4edb-aca9-1683fcf8c1ff None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=2fddf039f65a4cff95c9c2041dd81ef6, role_id=117a8af4218c4823b9f45e58df8c8be1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:55.791633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb55b16-decc-4edb-aca9-1683fcf8c1ff None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:55.800569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a23234-0d4f-47a6-bc6c-bed384fbb45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:55.808840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 296/609] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:55 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/2fddf039f65a4cff95c9c2041dd81ef6/roles/117a8af4218c4823b9f45e58df8c8be1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-15a23234-0d4f-47a6-bc6c-bed384fbb45e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:55.809875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:55.810992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:55.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 314/610] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:55.817197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb55b16-decc-4edb-aca9-1683fcf8c1ff None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:55.931802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb55b16-decc-4edb-aca9-1683fcf8c1ff None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:55.973086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:55.973835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:55.974118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:55.974394 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:55.975260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:55.975577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:55.977037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:55.986757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 297/611] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:55.992559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a23234-0d4f-47a6-bc6c-bed384fbb45e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:56.096195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a23234-0d4f-47a6-bc6c-bed384fbb45e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:56.130320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:56.131118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:56.131393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:56.131663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:56.142665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:56.144140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:56.164016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:56.164976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:56.165915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:56.165915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:56.165915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:56.165915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:56.165915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 315/612] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:56.171243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:56.337075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beefa7-b217-476e-b2e0-59e84f06fce3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:56.380905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:56.381717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:56.381904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:56.382136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:56.382858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:56.383158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:56.384534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:56.404091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 298/613] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:56.409083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:56.565848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186afb-4985-43c4-85ef-b71ed75ce3e1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:56.619615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263dcd8-2d13-494d-b9c0-6b527f08ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:56.620758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263dcd8-2d13-494d-b9c0-6b527f08ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:56.621237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263dcd8-2d13-494d-b9c0-6b527f08ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:56.621737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263dcd8-2d13-494d-b9c0-6b527f08ef3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:56.632895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263dcd8-2d13-494d-b9c0-6b527f08ef3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:56.634687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263dcd8-2d13-494d-b9c0-6b527f08ef3d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e263dcd8-2d13-494d-b9c0-6b527f08ef3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:56.653917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:56.654927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:26:56.655884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:56.658620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 316/614] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:26:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:56.666657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:56.748507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621d79c-d69b-4052-8f15-08f78290e0e7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:56.748849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621d79c-d69b-4052-8f15-08f78290e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:56.749122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621d79c-d69b-4052-8f15-08f78290e0e7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:56.750679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 317/615] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:56.758763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1eaa4-2cb2-4c03-8276-3e9fd7a7eb46 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:56.758763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1eaa4-2cb2-4c03-8276-3e9fd7a7eb46 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:56.758763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1eaa4-2cb2-4c03-8276-3e9fd7a7eb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:56.776844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c8d1eaa4-2cb2-4c03-8276-3e9fd7a7eb46 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:56.778534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c8d1eaa4-2cb2-4c03-8276-3e9fd7a7eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:56.852232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 318/616] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:26:56.871837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f248af6-18b9-45c3-9267-bb48ee9720a0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:56.876950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1eaa4-2cb2-4c03-8276-3e9fd7a7eb46 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:56.938030 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:56.938783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:56.939064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:56.939386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:56.940355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:56.940685 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:56.942383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:56.983439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 299/617] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:26:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:56.989988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:57.101149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1eaa4-2cb2-4c03-8276-3e9fd7a7eb46 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:57.103367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618d24-2fcf-41f2-bf7a-c96e7db19b1f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:57.137321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f1821-fa82-4496-b6ee-5927e8a420a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:57.138005 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1821-fa82-4496-b6ee-5927e8a420a0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.138283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1821-fa82-4496-b6ee-5927e8a420a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.138555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1821-fa82-4496-b6ee-5927e8a420a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.193689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabacd3a-e173-4cf5-8682-b37f39f4a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:57.194504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacd3a-e173-4cf5-8682-b37f39f4a7bd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.194786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacd3a-e173-4cf5-8682-b37f39f4a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.195060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacd3a-e173-4cf5-8682-b37f39f4a7bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.207040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f1821-fa82-4496-b6ee-5927e8a420a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:57.213575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f1821-fa82-4496-b6ee-5927e8a420a0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:57.230454 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabacd3a-e173-4cf5-8682-b37f39f4a7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-dabacd3a-e173-4cf5-8682-b37f39f4a7bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:57.246276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:57.247287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:57.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 319/618] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:57.253158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabacd3a-e173-4cf5-8682-b37f39f4a7bd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:57.306160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 300/619] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:57.315037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f1821-fa82-4496-b6ee-5927e8a420a0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:57.447848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabacd3a-e173-4cf5-8682-b37f39f4a7bd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:57.483250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:57.483928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.484265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.484542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.485301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:57.485631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:57.487324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:57.497375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 320/620] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:57.499525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f1821-fa82-4496-b6ee-5927e8a420a0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:57.502592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:57.554289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776f25-41fe-4d67-9316-bc444a9a207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:57.555106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f25-41fe-4d67-9316-bc444a9a207e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.555462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f25-41fe-4d67-9316-bc444a9a207e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.555746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f25-41fe-4d67-9316-bc444a9a207e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.567860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776f25-41fe-4d67-9316-bc444a9a207e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:57.569286 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776f25-41fe-4d67-9316-bc444a9a207e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-0f776f25-41fe-4d67-9316-bc444a9a207e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:57.588755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:57.589745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:57.591505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:57.591505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:57.591505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:57.591505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:57.591505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 301/621] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:57.594539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c408be-91b2-4a83-9ca8-bd39ca15172a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.595097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c408be-91b2-4a83-9ca8-bd39ca15172a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.595383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c408be-91b2-4a83-9ca8-bd39ca15172a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.596682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 302/622] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:26:57.597363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c408be-91b2-4a83-9ca8-bd39ca15172a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:57.660931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e622e-39d6-42d5-91bb-857719108349 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:57.694079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2c337-9eae-44eb-b786-83f6358e17e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:57.694875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c337-9eae-44eb-b786-83f6358e17e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.695156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c337-9eae-44eb-b786-83f6358e17e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.695432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c337-9eae-44eb-b786-83f6358e17e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.705907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2c337-9eae-44eb-b786-83f6358e17e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:57.707296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2c337-9eae-44eb-b786-83f6358e17e8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:57.716885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c408be-91b2-4a83-9ca8-bd39ca15172a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4cb2c337-9eae-44eb-b786-83f6358e17e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:57.724314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:57.726405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:57.728523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:57.728523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:57.728523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:57.728523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:57.728523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 321/623] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:26:57.728523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333ae7-d37c-4c7f-9893-e2093d503494 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.728523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333ae7-d37c-4c7f-9893-e2093d503494 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.728523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333ae7-d37c-4c7f-9893-e2093d503494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.750259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a8333ae7-d37c-4c7f-9893-e2093d503494 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:57.750462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:57.751172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.751453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.751730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.752284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a8333ae7-d37c-4c7f-9893-e2093d503494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:57.752486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:57.752791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:57.754334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:57.769634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 303/624] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:57.770461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:57.832712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 322/625] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:57.833605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8333ae7-d37c-4c7f-9893-e2093d503494 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:57.888841 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49020ca5-c0fc-4aab-bc2a-da8fd9255aca None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:57.921789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:57.922459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.922739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.923010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.923732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:57.924032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:57.925405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:57.937150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8333ae7-d37c-4c7f-9893-e2093d503494 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:57.938008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 304/626] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:57.938908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:57.974146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:57.975355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:57.975834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:57.976323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:57.984352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:57.986126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:58.000340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:58.001299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:58.002211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:58.002211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:58.002211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:58.002211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:58.002211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:58.002211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:58.002211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:58.002211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:58.004410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 323/627] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:58.005392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.037538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cb472-1204-423a-83ef-b3fb81645fda None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.073839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7adef-802a-486a-82bb-b8b6518f0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.074648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7adef-802a-486a-82bb-b8b6518f0b91 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.074990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7adef-802a-486a-82bb-b8b6518f0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.075266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7adef-802a-486a-82bb-b8b6518f0b91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.085796 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7adef-802a-486a-82bb-b8b6518f0b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a0e7adef-802a-486a-82bb-b8b6518f0b91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:58.093713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:58.094643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:58.095487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 305/628] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:58.096175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7adef-802a-486a-82bb-b8b6518f0b91 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.115619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e945-9f56-4820-b44c-e9dd65af78fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.149726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.150897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.151376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.151862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.160404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:58.162163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:58.176992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:58.178259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 17:26:58.179216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:58.181709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 324/629] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:58.182789 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.194688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7adef-802a-486a-82bb-b8b6518f0b91 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.228216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.228813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.229078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.229348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.230166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:58.230512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:58.231939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.246386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 306/630] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:58.247281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.286181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166ae27-9f43-45cb-b8c4-0770a8dd9549 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.318364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0be2b-45e0-4ce4-820e-8464ebbc3610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.322550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0be2b-45e0-4ce4-820e-8464ebbc3610 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.322550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0be2b-45e0-4ce4-820e-8464ebbc3610 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.322550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0be2b-45e0-4ce4-820e-8464ebbc3610 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.322550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0be2b-45e0-4ce4-820e-8464ebbc3610 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:58.322550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0be2b-45e0-4ce4-820e-8464ebbc3610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:58.323453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0be2b-45e0-4ce4-820e-8464ebbc3610 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.331430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 325/631] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:58.332749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28612ace-f311-45e4-9901-da5cd1f27683 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.333025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28612ace-f311-45e4-9901-da5cd1f27683 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.333295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28612ace-f311-45e4-9901-da5cd1f27683 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.334695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 326/632] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:58.339429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28612ace-f311-45e4-9901-da5cd1f27683 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.348735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975af3c9-6a95-4941-a6a4-a277fec9f6b4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.382138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.383063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.383496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.383932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.384919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:58.385387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:58.386860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.409732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 307/633] 10.222.0.58 () {56 vars in 1135 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:58.410750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.440437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28612ace-f311-45e4-9901-da5cd1f27683 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.473921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a26ed-b37d-4cdf-8941-c57fcd196fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.474550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a26ed-b37d-4cdf-8941-c57fcd196fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.474830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a26ed-b37d-4cdf-8941-c57fcd196fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.475103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a26ed-b37d-4cdf-8941-c57fcd196fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.475924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a26ed-b37d-4cdf-8941-c57fcd196fe0 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=a7263b80be2c437997b1a18002c9969d) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:58.476263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a26ed-b37d-4cdf-8941-c57fcd196fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:58.477719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a26ed-b37d-4cdf-8941-c57fcd196fe0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.493667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 327/634] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/role_assignments?user.id=a7263b80be2c437997b1a18002c9969d&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:58.493667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429af1c-6e4f-46dd-9a35-e5e41147365a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.493667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429af1c-6e4f-46dd-9a35-e5e41147365a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.493667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429af1c-6e4f-46dd-9a35-e5e41147365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.513753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e429af1c-6e4f-46dd-9a35-e5e41147365a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:58.515045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e429af1c-6e4f-46dd-9a35-e5e41147365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:58.523385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3d85-f333-4f5c-97ff-f6627390f889 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.560955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.561801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.562079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.562351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.574570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:58.576229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:58.595470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:58.596484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:58.597401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:58.597401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:58.597401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:58.597401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:58.597401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 308/635] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:58.598199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.608376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 328/636] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:58.609866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3952f5-9801-4830-a6f5-64fbb17b28e6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.610225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3952f5-9801-4830-a6f5-64fbb17b28e6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.610573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3952f5-9801-4830-a6f5-64fbb17b28e6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.616275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 329/637] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:26:58.616275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3952f5-9801-4830-a6f5-64fbb17b28e6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.720835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed0243-f35c-4243-9aef-fc25d558f037 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.731290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3952f5-9801-4830-a6f5-64fbb17b28e6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.760831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.761577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.761862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.762135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.767570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ff8bb-31d3-4535-9f8d-39ad55e27e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.768432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff8bb-31d3-4535-9f8d-39ad55e27e56 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.768866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff8bb-31d3-4535-9f8d-39ad55e27e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.769143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff8bb-31d3-4535-9f8d-39ad55e27e56 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.769967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ff8bb-31d3-4535-9f8d-39ad55e27e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:58.770286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ff8bb-31d3-4535-9f8d-39ad55e27e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:58.771661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ff8bb-31d3-4535-9f8d-39ad55e27e56 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.772608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:58.774089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:58.785610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 330/638] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:58.785610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e686-c3e5-48c9-bd8d-c5267118c34c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.785610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e686-c3e5-48c9-bd8d-c5267118c34c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.785610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e686-c3e5-48c9-bd8d-c5267118c34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:58.794449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:58.795365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:58.796267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:58.796267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:58.796267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:58.796267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:58.796267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 309/639] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:58.796574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.804321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1f15e686-c3e5-48c9-bd8d-c5267118c34c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:58.805480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f15e686-c3e5-48c9-bd8d-c5267118c34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:58.874738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 331/640] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:26:58.875706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15e686-c3e5-48c9-bd8d-c5267118c34c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:58.895688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029764-db7a-4710-a3c9-352ba79981bc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:58.931551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4ccf9-36c7-417f-93ac-13146ca30c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:58.932356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ccf9-36c7-417f-93ac-13146ca30c0a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:58.932636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ccf9-36c7-417f-93ac-13146ca30c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:58.932907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ccf9-36c7-417f-93ac-13146ca30c0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:58.944210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4ccf9-36c7-417f-93ac-13146ca30c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-acb4ccf9-36c7-417f-93ac-13146ca30c0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:58.954231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:58.955204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:58.956044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 310/641] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:58.957445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4ccf9-36c7-417f-93ac-13146ca30c0a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.000579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15e686-c3e5-48c9-bd8d-c5267118c34c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.034436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.035500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.035500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.035686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.042920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.044401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.053134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4ccf9-36c7-417f-93ac-13146ca30c0a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:26:59.059867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:59.060915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 332/642] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:59.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.086514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.087457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.087922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.088388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.089129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:59.089415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.090921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.107442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 311/643] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:59.107442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.168073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f64716-ef12-4c1a-bce7-5a4af9c792de None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.200715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048cbf1-9a1a-43b8-b66d-9889e3c6478e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.205911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51652ab-54c4-487b-8710-9d2dc2afd4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.206325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51652ab-54c4-487b-8710-9d2dc2afd4fa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.206601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51652ab-54c4-487b-8710-9d2dc2afd4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.206851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51652ab-54c4-487b-8710-9d2dc2afd4fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.218394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51652ab-54c4-487b-8710-9d2dc2afd4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f51652ab-54c4-487b-8710-9d2dc2afd4fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:26:59.226251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:59.227196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:26:59.228091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 333/644] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:59.228831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51652ab-54c4-487b-8710-9d2dc2afd4fa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.240192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.240868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.241144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.241428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.242178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:59.242472 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.244047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.252169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 312/645] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:59.252869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.339253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51652ab-54c4-487b-8710-9d2dc2afd4fa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.348142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a59f7-0fc4-4594-a4f6-3b6aa6f3adda None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.372125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.372800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.373085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.373359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.374227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:59.374534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.375988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.383635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.384436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.384713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.384972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.391893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.393327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.393767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 334/646] 10.222.0.58 () {56 vars in 1137 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:59.394822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:26:59.411150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:59.412055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:59.413113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:26:59.413113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:26:59.413113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:26:59.413113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:26:59.413113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:26:59.413113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:26:59.413113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:26:59.413113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:59.416909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 313/647] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:59.417778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.494014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357f6a-2bfd-45c4-b105-30afe38a9c7a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.513077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12626f5-4843-4c0f-a20e-0c2e58050bdf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.525787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.526478 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.526754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.527027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.527767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:59.528101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.529474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.539694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 335/648] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:59.540775 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.550687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.551890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.552092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.552328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.562232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.563664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:59.580847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:59.582069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:59.582961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:59.582961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:59.582961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:59.582961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:59.582961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 314/649] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:59.582961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.640167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200f53-217b-40af-a2a8-c1977b730466 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.673592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c40a3-696d-4365-947c-b17b48aeb49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.674269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c40a3-696d-4365-947c-b17b48aeb49b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.674548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c40a3-696d-4365-947c-b17b48aeb49b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.674820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c40a3-696d-4365-947c-b17b48aeb49b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.688989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a9ca-f4c3-467f-b8e8-4fc00f0b2a92 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.725779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.726918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.727500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.728209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.729439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:59.730038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.732265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.739571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c40a3-696d-4365-947c-b17b48aeb49b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.741009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c40a3-696d-4365-947c-b17b48aeb49b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.747022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 315/650] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:59.748033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.838770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 336/651] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:26:59.839674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c40a3-696d-4365-947c-b17b48aeb49b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.853849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a13629-dab8-483c-bf84-ec416d2b7065 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.891147 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.891859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.892132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.892403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.903639 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.905199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:26:59.921761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:26:59.922664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:26:59.923567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:26:59.923567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:26:59.923567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:26:59.923567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:26:59.923567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 316/652] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:26:59.923837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:59.941276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c40a3-696d-4365-947c-b17b48aeb49b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:59.977262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:59.978273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:59.978546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:59.978811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:59.979529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:59.979863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:59.981268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:59.996618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 337/653] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:59.996618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.018328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c625-1952-4bbd-821b-41628e4726c4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.049519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf765c-e84f-4fe2-ad19-34211a223b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.050430 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf765c-e84f-4fe2-ad19-34211a223b4d None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.050706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf765c-e84f-4fe2-ad19-34211a223b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.050975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf765c-e84f-4fe2-ad19-34211a223b4d None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/6f320795fd0b42319df94dbc171938b8/roles/117a8af4218c4823b9f45e58df8c8be1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.065425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf765c-e84f-4fe2-ad19-34211a223b4d None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=6f320795fd0b42319df94dbc171938b8, role_id=117a8af4218c4823b9f45e58df8c8be1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.066947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf765c-e84f-4fe2-ad19-34211a223b4d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.080030 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 317/654] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:26:59 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/6f320795fd0b42319df94dbc171938b8/roles/117a8af4218c4823b9f45e58df8c8be1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:27:00.080820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf765c-e84f-4fe2-ad19-34211a223b4d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.091696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac26951-5c03-465b-993e-f4aeb05801f7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.127472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.128666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.129148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.129653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.142246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.144092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:00.164885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:00.165902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:00.166780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:00.166780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:00.166780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:00.166780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:00.169276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 338/655] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:00.170890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.193234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf765c-e84f-4fe2-ad19-34211a223b4d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.228066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.228737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.229014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.229283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.230037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:00.230336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.231801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.250908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 318/656] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:00.252566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.280376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac2879-e0bd-47ac-b22f-b22f3d811a65 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.316178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.316975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.317252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.317516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] PATH_INFO: `/v3/users/glance` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.330580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.332827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:00.352253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:00.353251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 17:27:00.354256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:00.355413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 339/657] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:00.355980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.367251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaf0e8-47f5-49c2-9cbe-a98679e93e54 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.399295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.399881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.400172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.400456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.401124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:00.401421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.402813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.414782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 319/658] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:00.419788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.478612 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76921e-11ff-4539-9c36-9ee5745aeade None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.514514 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.514888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f12386-8049-4633-b327-03f279df7f06 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.515932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.516420 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.516883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.525087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.526886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:00.541723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:00.542716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 17:27:00.543729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:00.546935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 340/659] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:00.547987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.554548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.555480 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.555760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.556135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.556997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:00.557302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.558784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.582303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 320/660] 10.222.0.58 () {56 vars in 1137 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:00.583374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.667730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b7879-34d4-4efa-becc-133fdbf25c9a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.694587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7f6f-f263-4a18-a686-ce21c30215a2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.708068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.709711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.710170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.710791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.719674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.721926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.736032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.736996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.737458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.737969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:00.738313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:00.739168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:00.740057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:00.740057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:00.740057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:00.740057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:00.740057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:00.740057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:00.740057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:00.740057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:00.741622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:00.742110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.743700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.744174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 341/661] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:00.744980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.767438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 321/662] 10.222.0.58 () {56 vars in 1139 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:00.768502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.845147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712c8e9-f2b0-4d1a-8d64-bf0fdd104b7f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.864657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14e21-ea6d-4d44-8d7d-83cd58848279 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:00.877344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29e01e-92b9-4787-96e1-ef8b7955117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.878216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29e01e-92b9-4787-96e1-ef8b7955117d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.878645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29e01e-92b9-4787-96e1-ef8b7955117d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.878919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29e01e-92b9-4787-96e1-ef8b7955117d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.898606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:00.899271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:00.899554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:00.899817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:00.900600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:00.900898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.902350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:00.921371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 322/663] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:00.921371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:00.947981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29e01e-92b9-4787-96e1-ef8b7955117d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:00.949436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29e01e-92b9-4787-96e1-ef8b7955117d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.018916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6f711-64ac-4a97-9c63-1e6e2bf4f40f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.045728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 342/664] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:27:01.047213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6220bc-adda-4a74-9647-24b996192ca3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.047650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6220bc-adda-4a74-9647-24b996192ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.048046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6220bc-adda-4a74-9647-24b996192ca3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.054246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 343/665] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:01.055125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6220bc-adda-4a74-9647-24b996192ca3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.055992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb11109-f55d-4aed-877f-40132d320937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.056658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11109-f55d-4aed-877f-40132d320937 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.056938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11109-f55d-4aed-877f-40132d320937 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.057209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11109-f55d-4aed-877f-40132d320937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.122381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb11109-f55d-4aed-877f-40132d320937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:01.123818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb11109-f55d-4aed-877f-40132d320937 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.155760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6220bc-adda-4a74-9647-24b996192ca3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.188276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.188911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.189134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.189377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.190227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=0a0ca8aafef94f3399c92a91f5bff1ef) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:01.190533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:01.191948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.197850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 344/666] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/role_assignments?user.id=0a0ca8aafef94f3399c92a91f5bff1ef&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:01.210355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.226737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 323/667] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:27:01.226737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de9984-59ca-43ec-b529-6ef8ce92256a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.226737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de9984-59ca-43ec-b529-6ef8ce92256a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.226737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de9984-59ca-43ec-b529-6ef8ce92256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.243783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-99de9984-59ca-43ec-b529-6ef8ce92256a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:01.245167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-99de9984-59ca-43ec-b529-6ef8ce92256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:01.322350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 324/668] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:27:01.323434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de9984-59ca-43ec-b529-6ef8ce92256a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.333860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ba9f5-f3bb-4094-b093-0512f8f47bcc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.369208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.370522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.371027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.371522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.383788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:01.385772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:01.406173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:01.407211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:01.408134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:01.408134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:01.408134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:01.408134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:01.410622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 345/669] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:01.411840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.448510 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de9984-59ca-43ec-b529-6ef8ce92256a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.487528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.488336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.488617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.488891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.500490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:01.501984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:01.523969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:01.524936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:01.526484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:01.526484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:01.526484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:01.526484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:01.526484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 325/670] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:01.526484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.534666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc2298-0467-4de4-82c5-69b3600929e9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.579676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04519b8a-cd5e-4369-af3b-f3dd91848508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.580861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519b8a-cd5e-4369-af3b-f3dd91848508 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.581344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519b8a-cd5e-4369-af3b-f3dd91848508 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.581968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519b8a-cd5e-4369-af3b-f3dd91848508 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.595935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04519b8a-cd5e-4369-af3b-f3dd91848508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-04519b8a-cd5e-4369-af3b-f3dd91848508 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:01.605690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:01.606765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:01.607635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:01.610619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 346/671] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:01.611581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04519b8a-cd5e-4369-af3b-f3dd91848508 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.635975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8b304-4219-479e-a81e-36d61995b4ce None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.678587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.679902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.680583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.681014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.682073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:01.682823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:01.684818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.700380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 326/672] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:01.701811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.724023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04519b8a-cd5e-4369-af3b-f3dd91848508 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.757059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.758236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.758236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.758628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.759461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:01.759861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:01.761400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.773883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 347/673] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:01.774882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.823895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1dc8b-5cd6-4720-9feb-8a064d40a0b3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.858305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.859222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.859631 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.860066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.860949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:01.861390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:01.863043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.872176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 327/674] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:01.873253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.878986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beea98-c190-4d3b-b9fe-fe02e643b54d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:01.913402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:01.914190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:01.914563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:01.914934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:01.921911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:01.923472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:01.937650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:01.938817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:01.939922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:01.939922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:01.939922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:01.939922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:01.939922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:01.939922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:01.939922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:01.939922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:01.941607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 348/675] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:01.942466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:01.977104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919308b-9c04-4a01-a400-e68253307857 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.011571 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.012681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.013169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.013643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.021214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.022871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:02.038245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:02.039350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:02.040419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:02.040419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:02.040419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:02.040419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:02.040419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:02.040419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:02.040419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:02.040419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:02.042614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 328/676] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:02.043666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.048296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c12d39-e0d8-4f69-abe0-1737c5f498f2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.082287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.083423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.083794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.084159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.095766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.097355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:02.114527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:02.115742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:02.116875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:02.116875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:02.116875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:02.116875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:02.122661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 349/677] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:02.123975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.151302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867bc0d-b5ab-408c-b6bf-315edc625564 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.186388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.187349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.187799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.188212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.189267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:02.189775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.191431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.211278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 329/678] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:02.212470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.228147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5248ac-8f83-42a6-a750-faa0cddb2df0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.261192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.262034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.262489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.262861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.263733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:02.264156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.265707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.278178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 350/679] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:02.279299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.315147 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb51c40-b6f0-4819-a954-a8954ed0dc12 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.348058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.349073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.349518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.350026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.350967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:02.351438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.352979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.365533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 330/680] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:02.366767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.382852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e77f7-a234-44b8-9c9e-7a1a7e5c7a77 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.415355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.416016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.416289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.416555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.417370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=43278916b971416e80a79077cf0da75d) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:02.417703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.419194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.429578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 351/681] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/role_assignments?user.id=43278916b971416e80a79077cf0da75d&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:02.429578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.484571 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a9921-491c-4353-b0d3-5531f3692537 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.522492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847d1db-f252-4987-9fb5-bc4f9a00ad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.523169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847d1db-f252-4987-9fb5-bc4f9a00ad82 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.523448 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847d1db-f252-4987-9fb5-bc4f9a00ad82 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.523720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847d1db-f252-4987-9fb5-bc4f9a00ad82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.524559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847d1db-f252-4987-9fb5-bc4f9a00ad82 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=2fddf039f65a4cff95c9c2041dd81ef6) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:02.524948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847d1db-f252-4987-9fb5-bc4f9a00ad82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.526433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847d1db-f252-4987-9fb5-bc4f9a00ad82 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.533527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 331/682] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/role_assignments?user.id=2fddf039f65a4cff95c9c2041dd81ef6&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:02.535062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf1cf-deb3-4bd1-8d11-deea0a7b21fc None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.535356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf1cf-deb3-4bd1-8d11-deea0a7b21fc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.535628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf1cf-deb3-4bd1-8d11-deea0a7b21fc None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.537582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 332/683] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:02.547226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b9b8-53bd-4e1a-b30f-ad71bdd28a72 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.547808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b9b8-53bd-4e1a-b30f-ad71bdd28a72 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.548227 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b9b8-53bd-4e1a-b30f-ad71bdd28a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.567883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ffc1-603e-480f-801b-2bd936da41d5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.597211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8d63b9b8-53bd-4e1a-b30f-ad71bdd28a72 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:02.598863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8d63b9b8-53bd-4e1a-b30f-ad71bdd28a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:02.654531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.654531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.654841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.655107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.663635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.665371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:02.681330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:02.682621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:02.683808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 352/684] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:02.688885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.713526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 333/685] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:27:02.742362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b9b8-53bd-4e1a-b30f-ad71bdd28a72 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.821400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc30bc-336f-46bd-b353-0660700c914e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.858169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.858792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.859067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.859336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.860180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:02.860484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:02.861380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b9b8-53bd-4e1a-b30f-ad71bdd28a72 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:02.862766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:02.881746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 353/686] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:02.890107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:02.903297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b3892-df90-4fc7-80a5-7d198ec63d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:02.904247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3892-df90-4fc7-80a5-7d198ec63d79 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:02.904590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3892-df90-4fc7-80a5-7d198ec63d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:02.904966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3892-df90-4fc7-80a5-7d198ec63d79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:02.915859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b3892-df90-4fc7-80a5-7d198ec63d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d20b3892-df90-4fc7-80a5-7d198ec63d79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:02.923877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:02.925022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:27:02.926392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:02.927871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 334/687] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:02.934240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b3892-df90-4fc7-80a5-7d198ec63d79 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:03.027653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cbbdd-9930-40a8-aa8d-8dc7598031bf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:03.054271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b3892-df90-4fc7-80a5-7d198ec63d79 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:03.098253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:03.098935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.099210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.099483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.100231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:03.100534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:03.101948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:03.108721 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db490-619f-4ba4-9afc-abdfc9461faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:03.109603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db490-619f-4ba4-9afc-abdfc9461faf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.110047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db490-619f-4ba4-9afc-abdfc9461faf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.110561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db490-619f-4ba4-9afc-abdfc9461faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.115355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 335/688] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:03.125587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:03.190285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96db490-619f-4ba4-9afc-abdfc9461faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:03.192077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96db490-619f-4ba4-9afc-abdfc9461faf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:03.280518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0bb8f-8013-4249-9013-294eaf3c3343 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:03.312921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 354/689] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:27:03.321311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db490-619f-4ba4-9afc-abdfc9461faf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:03.339769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:03.340573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.340851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.341147 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.362485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:03.364149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:03.399857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:03.401052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:03.402199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:03.402199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:03.402199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:03.402199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:03.406080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 336/690] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:03.411312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:03.469400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db490-619f-4ba4-9afc-abdfc9461faf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:03.525445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:03.526409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.526693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.526965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.544878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:03.547434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:03.574483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:03.575466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:03.576347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:03.576347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:03.576347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:03.576347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:03.576347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 355/691] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:03.580392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f92b26-3bca-44a0-96cb-5d43520ccc54 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:03.582695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:03.670632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:03.671403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.671674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.671947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.672672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:03.672972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:03.674406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:03.703779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 337/692] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:03.708846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:03.723571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44c55-6657-4ff3-b25f-63b65abb7425 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:03.756761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733aba-5d5e-4bc6-b276-b1be04c59ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:03.757443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733aba-5d5e-4bc6-b276-b1be04c59ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.757746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733aba-5d5e-4bc6-b276-b1be04c59ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.758016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733aba-5d5e-4bc6-b276-b1be04c59ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.758755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77733aba-5d5e-4bc6-b276-b1be04c59ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:03.759056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77733aba-5d5e-4bc6-b276-b1be04c59ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:03.760438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77733aba-5d5e-4bc6-b276-b1be04c59ec7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:03.772268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 356/693] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:03.773567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87279e-c779-47a9-9864-c5dd9852d472 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.773877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87279e-c779-47a9-9864-c5dd9852d472 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.774154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87279e-c779-47a9-9864-c5dd9852d472 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.779636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 357/694] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:03.780441 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87279e-c779-47a9-9864-c5dd9852d472 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:03.811540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc330f-5820-4fa5-895c-a55fd682510f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:03.848850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9c7e9-5423-4735-9e1c-d5830fb7d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:03.850047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c7e9-5423-4735-9e1c-d5830fb7d9cc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.850533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c7e9-5423-4735-9e1c-d5830fb7d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.850989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9c7e9-5423-4735-9e1c-d5830fb7d9cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.859637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9c7e9-5423-4735-9e1c-d5830fb7d9cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:03.861413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9c7e9-5423-4735-9e1c-d5830fb7d9cc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-5dd9c7e9-5423-4735-9e1c-d5830fb7d9cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:03.876533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:03.877493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 17:27:03.878846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:03.881317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 338/695] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:03.882815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad601f0-63f5-48a0-a985-926445e0ad6d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.883290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad601f0-63f5-48a0-a985-926445e0ad6d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.883759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad601f0-63f5-48a0-a985-926445e0ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.901119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1ad601f0-63f5-48a0-a985-926445e0ad6d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:03.902702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1ad601f0-63f5-48a0-a985-926445e0ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:03.912225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87279e-c779-47a9-9864-c5dd9852d472 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:03.955460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:03.956318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:03.956601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:03.956881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:03.965948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:03.967968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:03.973368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 339/696] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:27:03.974630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad601f0-63f5-48a0-a985-926445e0ad6d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:03.986713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:03.987710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:03.988607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:03.988607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:03.988607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:03.988607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:03.988607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:03.988607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:03.988607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:03.988607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:03.992746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 358/697] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:03.994059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:04.094274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3cf22-9863-4884-b42b-a2f0c3a191fa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:04.100035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad601f0-63f5-48a0-a985-926445e0ad6d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:04.132436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:04.133472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:04.134030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:04.134493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:04.135500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:04.136010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:04.137783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:04.142492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:04.143191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:04.143470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:04.143748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:04.144596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:04.144893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:04.146447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:04.153489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 359/698] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:04.154593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:04.174705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 340/699] 10.222.0.58 () {56 vars in 1135 bytes} [Mon May 16 17:27:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:04.175781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:04.260788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537715-cf88-452f-9cbd-b6e35a326182 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:04.291568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598718-fa3e-4b6c-8a94-fa7eeeaffa74 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:04.295426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:04.296350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:04.296691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:04.297067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:04.297824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:04.299337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:04.313582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:04.314969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:04.315794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:04.320240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 360/700] 10.222.0.58 () {56 vars in 1129 bytes} [Mon May 16 17:27:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:04.320650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:04.327967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:04.328630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:04.328906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:04.329178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:04.330484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=a7263b80be2c437997b1a18002c9969d) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:04.330791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:04.332593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:04.345730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 341/701] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:04 2022] GET /identity/v3/role_assignments?user.id=a7263b80be2c437997b1a18002c9969d&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:04.346633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:04.494649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d337a-9d1b-4df9-83d3-4d41b606e74c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:04.533441 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35717790-4720-47b8-a331-082ec9a74e4c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:04.558468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f376f-dba2-4404-b6dd-14563e09b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:04.559240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f376f-dba2-4404-b6dd-14563e09b21b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:04.559519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f376f-dba2-4404-b6dd-14563e09b21b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:04.559803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f376f-dba2-4404-b6dd-14563e09b21b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:04.605680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:04.605680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:04.605680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:04.605680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:04.606492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:04.606492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:04.609568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:04.617128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 342/702] 10.222.0.58 () {56 vars in 1124 bytes} [Mon May 16 17:27:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:04.625579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:04.698240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f376f-dba2-4404-b6dd-14563e09b21b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:04.699789 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f376f-dba2-4404-b6dd-14563e09b21b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:04.850579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 361/703] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 17:27:04.857896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f376f-dba2-4404-b6dd-14563e09b21b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:04.879519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebdc36-a9b8-43e7-b49f-e8e20beb5f79 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:04.958037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:04.958594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f376f-dba2-4404-b6dd-14563e09b21b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:04.958772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:04.959004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:04.959279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:04.960004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:04.960307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:04.961711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:04.967945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 343/704] 10.222.0.58 () {56 vars in 1124 bytes} [Mon May 16 17:27:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:05.009404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dea02a-5f9b-49e2-b2bf-cfeadacb386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.010263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dea02a-5f9b-49e2-b2bf-cfeadacb386c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.010540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dea02a-5f9b-49e2-b2bf-cfeadacb386c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.010809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dea02a-5f9b-49e2-b2bf-cfeadacb386c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.029311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dea02a-5f9b-49e2-b2bf-cfeadacb386c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.030832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dea02a-5f9b-49e2-b2bf-cfeadacb386c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e9dea02a-5f9b-49e2-b2bf-cfeadacb386c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:05.061539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:05.063652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:05.065731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:05.065731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:05.065731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:05.065731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:05.065731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 362/705] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:05.070699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.099518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55841-d2fa-4e7e-94a4-1beda824aec1 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.099857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55841-d2fa-4e7e-94a4-1beda824aec1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.100069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55841-d2fa-4e7e-94a4-1beda824aec1 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.101931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 363/706] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:05.108242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826810-e4d7-4ef1-934e-19d2b14551d8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.108545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826810-e4d7-4ef1-934e-19d2b14551d8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.108729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826810-e4d7-4ef1-934e-19d2b14551d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.127112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6b826810-e4d7-4ef1-934e-19d2b14551d8 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:05.128303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6b826810-e4d7-4ef1-934e-19d2b14551d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:05.208682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 364/707] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:27:05.230800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b826810-e4d7-4ef1-934e-19d2b14551d8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.261586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83752b0b-2d9f-4ad0-8291-d3b42c5915ee None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:05.295888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660766e9-8c52-4d32-9829-9ec1681d392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.296656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660766e9-8c52-4d32-9829-9ec1681d392b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.297010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660766e9-8c52-4d32-9829-9ec1681d392b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.297342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660766e9-8c52-4d32-9829-9ec1681d392b None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.299679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660766e9-8c52-4d32-9829-9ec1681d392b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:05.299679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660766e9-8c52-4d32-9829-9ec1681d392b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.299974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660766e9-8c52-4d32-9829-9ec1681d392b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.317575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 344/708] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:05.318300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7320e-35e8-4051-b055-894b2a114480 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.318582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7320e-35e8-4051-b055-894b2a114480 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.321599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7320e-35e8-4051-b055-894b2a114480 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.321599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 345/709] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:05.325092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7320e-35e8-4051-b055-894b2a114480 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.336874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b826810-e4d7-4ef1-934e-19d2b14551d8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:05.369443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64293c-1427-4cfb-95c1-6b437872b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.370230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64293c-1427-4cfb-95c1-6b437872b656 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.370511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64293c-1427-4cfb-95c1-6b437872b656 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.370832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64293c-1427-4cfb-95c1-6b437872b656 None admin] PATH_INFO: `/v3/services/network` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.371511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64293c-1427-4cfb-95c1-6b437872b656 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.372893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64293c-1427-4cfb-95c1-6b437872b656 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0d64293c-1427-4cfb-95c1-6b437872b656 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:05.384405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:05.385424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:05.386360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 365/710] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:05.387221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3648ed-a118-4408-b410-dcad5bc9bf53 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.387221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3648ed-a118-4408-b410-dcad5bc9bf53 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.387872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3648ed-a118-4408-b410-dcad5bc9bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.408063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bd3648ed-a118-4408-b410-dcad5bc9bf53 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:05.409236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bd3648ed-a118-4408-b410-dcad5bc9bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:05.439915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7320e-35e8-4051-b055-894b2a114480 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:05.474648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.475497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.475777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.476052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.483264 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.484752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.488734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 366/711] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:27:05.489914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3648ed-a118-4408-b410-dcad5bc9bf53 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:05.499089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:05.499992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:05.500890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 346/712] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:05.505809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.606138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3648ed-a118-4408-b410-dcad5bc9bf53 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:05.620529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e921-2c8a-40ae-acc3-9d9774ba65ba None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:05.645108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.646796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.647591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.648094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.649188 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] RBAC: Adding query filter params (name=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:05.650000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.651971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.658516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 367/713] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:05.659614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.664669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.664669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.664669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.664669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.665069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:05.665069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.665069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.679325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 347/714] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:05.680437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.784620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fdc8d-7545-4b31-b6f5-5fbbcc6bcf70 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:05.784834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c897da-4876-4009-a588-4a9bf42e805d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:05.818582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.819316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.819758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.819880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.820595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] RBAC: Adding query filter params (type=network) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:05.820941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.822300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.825011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.826040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.826460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.826905 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.833572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 348/715] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:05.833572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.852324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:05.889664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:05.890812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:05.891782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:05.891782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:05.891782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:05.891782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:05.894234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 368/716] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:05.899818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:05.938040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47499179-bfeb-420e-b820-6535f75f3cda None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:05.971179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:05.971886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:05.972172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:05.972449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:05.977577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=6f320795fd0b42319df94dbc171938b8) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:05.977577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:05.977577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:05.982160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 349/717] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/role_assignments?user.id=6f320795fd0b42319df94dbc171938b8&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:06.070140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d45ab-52cd-4753-8405-2da47e9f9806 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:06.124908 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4bb6-e133-4369-b805-73d191741c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:06.125628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4bb6-e133-4369-b805-73d191741c66 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:06.125909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4bb6-e133-4369-b805-73d191741c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:06.126175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4bb6-e133-4369-b805-73d191741c66 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:06.126927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4bb6-e133-4369-b805-73d191741c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:06.127226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4bb6-e133-4369-b805-73d191741c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:06.128679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4bb6-e133-4369-b805-73d191741c66 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:06.156657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 369/718] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:06.162583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:06.286437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8cbc0-bdd7-48ef-8234-a63c38818457 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:06.320245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f676f5b-f48a-4fb0-aeec-21558f95c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:06.321037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f5b-f48a-4fb0-aeec-21558f95c883 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:06.321315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f5b-f48a-4fb0-aeec-21558f95c883 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:06.321616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f5b-f48a-4fb0-aeec-21558f95c883 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:06.322360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f676f5b-f48a-4fb0-aeec-21558f95c883 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:06.323839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f676f5b-f48a-4fb0-aeec-21558f95c883 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:06.346060 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 350/719] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:27:06 2022] POST /identity/v3/users => generated 254 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:06.823787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324bc8-6d74-4033-aebb-b2ce56a24b71 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:06.824319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324bc8-6d74-4033-aebb-b2ce56a24b71 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:06.824319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324bc8-6d74-4033-aebb-b2ce56a24b71 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:06.826166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 370/720] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:06.831560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3609c-9220-4bdb-96a1-bc2542e4e253 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:06.831846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3609c-9220-4bdb-96a1-bc2542e4e253 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:06.832122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3609c-9220-4bdb-96a1-bc2542e4e253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:06.854750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a3c3609c-9220-4bdb-96a1-bc2542e4e253 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:06.856152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a3c3609c-9220-4bdb-96a1-bc2542e4e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:06.940447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 351/721] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 17:27:06.975074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324bc8-6d74-4033-aebb-b2ce56a24b71 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:07.103884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324bc8-6d74-4033-aebb-b2ce56a24b71 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:07.163252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad3bc-45d9-4f00-a856-3783bac29bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:07.164083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad3bc-45d9-4f00-a856-3783bac29bee None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:07.164363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad3bc-45d9-4f00-a856-3783bac29bee None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:07.164639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad3bc-45d9-4f00-a856-3783bac29bee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:07.182444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ad3bc-45d9-4f00-a856-3783bac29bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-818ad3bc-45d9-4f00-a856-3783bac29bee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:07.190205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:07.191230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:07.192084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 371/722] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:07.199518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3609c-9220-4bdb-96a1-bc2542e4e253 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:07.313316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3609c-9220-4bdb-96a1-bc2542e4e253 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:07.357032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349ca03-9254-4d0c-8bdc-af454eb5a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:07.358089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ca03-9254-4d0c-8bdc-af454eb5a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:07.358570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ca03-9254-4d0c-8bdc-af454eb5a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:07.359070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ca03-9254-4d0c-8bdc-af454eb5a0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:07.360048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349ca03-9254-4d0c-8bdc-af454eb5a0b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:07.360569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349ca03-9254-4d0c-8bdc-af454eb5a0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:07.362215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349ca03-9254-4d0c-8bdc-af454eb5a0b3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:07.371234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 352/723] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:07.377328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad3bc-45d9-4f00-a856-3783bac29bee None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:07.540421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad3bc-45d9-4f00-a856-3783bac29bee None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:07.591284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:07.592083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:07.592360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:07.592629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:07.607726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:07.609165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:07.628164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:07.629155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:07.630112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:07.630112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:07.630112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:07.630112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:07.630112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 372/724] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:07.634105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ac778-2e58-4ec8-9aa1-af8652d17bcf None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:07.634105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ac778-2e58-4ec8-9aa1-af8652d17bcf None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:07.634105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ac778-2e58-4ec8-9aa1-af8652d17bcf None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:07.635053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:07.635341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 353/725] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:07.640586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34387cfb-201c-4f93-a7bf-529d8ff1d441 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:07.641241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34387cfb-201c-4f93-a7bf-529d8ff1d441 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:07.641777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34387cfb-201c-4f93-a7bf-529d8ff1d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:07.664576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-34387cfb-201c-4f93-a7bf-529d8ff1d441 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:07.666185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-34387cfb-201c-4f93-a7bf-529d8ff1d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:07.775314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 354/726] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:27:07.800202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24485-67a5-4fbe-8724-74c91d660ede None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:07.812787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34387cfb-201c-4f93-a7bf-529d8ff1d441 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:07.864040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:07.864725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:07.867170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:07.867170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:07.867170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:07.867170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:07.867490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:07.880122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 373/727] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:07.886533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:07.939347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34387cfb-201c-4f93-a7bf-529d8ff1d441 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:07.978986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce20b3-c471-4365-b6d5-e39c545ffaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:07.979682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce20b3-c471-4365-b6d5-e39c545ffaa0 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:07.979950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce20b3-c471-4365-b6d5-e39c545ffaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:07.980226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce20b3-c471-4365-b6d5-e39c545ffaa0 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:07.981025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce20b3-c471-4365-b6d5-e39c545ffaa0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:07.982421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce20b3-c471-4365-b6d5-e39c545ffaa0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:08.005736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 355/728] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:27:07 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:08.052204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb262b17-73c4-442b-8499-3d500030574a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:08.112602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:08.113424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:08.113723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:08.113990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:08.127050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:08.128474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:08.155485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:08.157895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:08.160206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 374/729] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:27:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:08.167746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce20b3-c471-4365-b6d5-e39c545ffaa0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:08.307958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce20b3-c471-4365-b6d5-e39c545ffaa0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:08.358179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b09d8-53e6-405d-a947-3a8f070307e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:08.358884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b09d8-53e6-405d-a947-3a8f070307e6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:08.359160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b09d8-53e6-405d-a947-3a8f070307e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:08.359431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b09d8-53e6-405d-a947-3a8f070307e6 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:08.360299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b09d8-53e6-405d-a947-3a8f070307e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:08.360603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b09d8-53e6-405d-a947-3a8f070307e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:08.362159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b09d8-53e6-405d-a947-3a8f070307e6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:08.392495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 356/730] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:27:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:08.398111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:08.500833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c003-8df1-4c2e-bced-617d6d84aaf9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:08.536350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:08.538215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aac4c6-417d-427d-917e-539862b8c39e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:08.538330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:08.538528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:08.538634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aac4c6-417d-427d-917e-539862b8c39e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:08.538840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aac4c6-417d-427d-917e-539862b8c39e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:08.538959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:08.540385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 357/731] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:08.545487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e487e-4afb-480a-a332-1853fc49556d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:08.545817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e487e-4afb-480a-a332-1853fc49556d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:08.546207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e487e-4afb-480a-a332-1853fc49556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:08.550389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:08.552496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:08.564719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9d2e487e-4afb-480a-a332-1853fc49556d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:08.565990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9d2e487e-4afb-480a-a332-1853fc49556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:08.571793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:08.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:08.573712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:08.573712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:08.573712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:08.573712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:08.575864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 375/732] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:08.581153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:08.672096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 358/733] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 17:27:08.707109 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e487e-4afb-480a-a332-1853fc49556d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:08.726089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754b15b-4eca-4d7a-8132-c730291b88bd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:08.770719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:08.771388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:08.771665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:08.771935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:08.772657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:08.772962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:08.774363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:08.789688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 376/734] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:08.791740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:08.890594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0a6db-b459-43f6-8e55-1194062f1ebd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:08.899667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e487e-4afb-480a-a332-1853fc49556d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:08.924172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:08.924894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:08.925171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:08.925442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:08.932983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:08.934580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:08.948953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:08.949997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:08.950990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:08.950990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:08.950990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:08.950990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:08.950990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:08.950990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:08.950990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:08.950990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:08.955316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 377/735] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:08.961860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:08.987456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f0bea-1626-4e41-92d7-981003da943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:08.988896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f0bea-1626-4e41-92d7-981003da943f None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:08.989380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f0bea-1626-4e41-92d7-981003da943f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:08.989877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f0bea-1626-4e41-92d7-981003da943f None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:08.990873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f0bea-1626-4e41-92d7-981003da943f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:08.992547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f0bea-1626-4e41-92d7-981003da943f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:09.039543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 359/736] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:27:08 2022] POST /identity/v3/services => generated 240 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:09.073669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31939b5-68e1-496a-8c5f-a92af1c7ab0d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:09.118176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1173a15-a749-4710-9914-a80da55079bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:09.118843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1173a15-a749-4710-9914-a80da55079bd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.119161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1173a15-a749-4710-9914-a80da55079bd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.119442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1173a15-a749-4710-9914-a80da55079bd None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.120233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1173a15-a749-4710-9914-a80da55079bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:09.120583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1173a15-a749-4710-9914-a80da55079bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:09.122170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1173a15-a749-4710-9914-a80da55079bd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:09.140406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 378/737] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:09.141860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f0bea-1626-4e41-92d7-981003da943f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:09.245637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaddad-99ac-431b-9bc8-d148209fec76 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.245947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaddad-99ac-431b-9bc8-d148209fec76 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.246407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaddad-99ac-431b-9bc8-d148209fec76 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.249133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 379/738] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:09.254014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a2e1-b4c3-488e-8e2c-a5068b613a9d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.254330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a2e1-b4c3-488e-8e2c-a5068b613a9d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.254581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a2e1-b4c3-488e-8e2c-a5068b613a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.289988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5b43a2e1-b4c3-488e-8e2c-a5068b613a9d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:09.291897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5b43a2e1-b4c3-488e-8e2c-a5068b613a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:09.374597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 380/739] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:09.381957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6f546-97ba-455f-bd1e-97628dbff644 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.382578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6f546-97ba-455f-bd1e-97628dbff644 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.383079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6f546-97ba-455f-bd1e-97628dbff644 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.385014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 381/740] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:09.399195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4063d-1867-40e1-93a4-3452f6d85503 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.399765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4063d-1867-40e1-93a4-3452f6d85503 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.400234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4063d-1867-40e1-93a4-3452f6d85503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.405453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f0bea-1626-4e41-92d7-981003da943f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:09.427252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-92f4063d-1867-40e1-93a4-3452f6d85503 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:09.428763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-92f4063d-1867-40e1-93a4-3452f6d85503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:09.439986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d5ee-2a2f-4d4d-a51c-066b58a7da94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:09.440885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d5ee-2a2f-4d4d-a51c-066b58a7da94 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.441179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d5ee-2a2f-4d4d-a51c-066b58a7da94 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.441421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d5ee-2a2f-4d4d-a51c-066b58a7da94 None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/a7263b80be2c437997b1a18002c9969d/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.443355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80d5ee-2a2f-4d4d-a51c-066b58a7da94 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=a7263b80be2c437997b1a18002c9969d, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:09.444786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80d5ee-2a2f-4d4d-a51c-066b58a7da94 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:09.462318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 360/741] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:27:09 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/a7263b80be2c437997b1a18002c9969d/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:27:09.463107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d5ee-2a2f-4d4d-a51c-066b58a7da94 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:09.503995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 382/742] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:09.529205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4063d-1867-40e1-93a4-3452f6d85503 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:09.582744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d5ee-2a2f-4d4d-a51c-066b58a7da94 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:09.625201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68312e7d-5043-4bc0-acba-7e4ed2c8ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:09.626201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68312e7d-5043-4bc0-acba-7e4ed2c8ed0f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.626481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68312e7d-5043-4bc0-acba-7e4ed2c8ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.626748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68312e7d-5043-4bc0-acba-7e4ed2c8ed0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.635977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4063d-1867-40e1-93a4-3452f6d85503 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:09.640301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68312e7d-5043-4bc0-acba-7e4ed2c8ed0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-68312e7d-5043-4bc0-acba-7e4ed2c8ed0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:09.649332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:09.650429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:09.651310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 361/743] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:09.660897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68312e7d-5043-4bc0-acba-7e4ed2c8ed0f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:09.693969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb7af7-ecc1-4378-8a0c-a02d85d7f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:09.696515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7af7-ecc1-4378-8a0c-a02d85d7f63d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.697182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7af7-ecc1-4378-8a0c-a02d85d7f63d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.697882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7af7-ecc1-4378-8a0c-a02d85d7f63d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.721814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb7af7-ecc1-4378-8a0c-a02d85d7f63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-92eb7af7-ecc1-4378-8a0c-a02d85d7f63d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:09.734036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:09.735053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:27:09.735900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:09.744594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 383/744] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:27:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:09.752571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb7af7-ecc1-4378-8a0c-a02d85d7f63d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:09.869752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb7af7-ecc1-4378-8a0c-a02d85d7f63d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:09.875662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68312e7d-5043-4bc0-acba-7e4ed2c8ed0f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:09.905481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:09.906186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.906456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.906722 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.907462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:09.907759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:09.909139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:09.918461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 384/745] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:27:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:09.923557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:09.963233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:09.963928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:09.964206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:09.966532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:09.966532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:09.966532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:09.968073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:09.989182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 362/746] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:09.995327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:10.031336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3ecd7-2ff2-48e8-bee9-8dd6537d2690 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:10.067734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:10.068546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:10.068820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:10.069220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:10.083829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:10.085673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:10.104671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:10.105685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:10.106636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:10.106636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:10.106636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:10.106636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:10.106636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 385/747] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:10.118604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:10.185063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e7071-35ea-474b-a468-b4fce20788e4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:10.225940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:10.226750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:10.227032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:10.227300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:10.248130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:10.249527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:10.282130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:10.283123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:10.284141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:10.284141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:10.284141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:10.284141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:10.284141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 363/748] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:10.293880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:10.322213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2bb4-3e05-4650-a779-a144c3c4999d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:10.363618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:10.364287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:10.364564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:10.364838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:10.365601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:10.365920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:10.367339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:10.402490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 386/749] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:10.419044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:10.499701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d82f66-8e89-43d9-9bad-898ed2abbaa1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:10.536325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d5a1e-e19f-4ba6-b91b-bfb098b90bc9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:10.573349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:10.574079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:10.574358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:10.574830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:10.575576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:10.575881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:10.577288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:10.579287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:10.580422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:10.580924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:10.581400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:10.599566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:10.601405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:10.613922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 364/750] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:10.631271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:10.754649 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b2d2f-b7ef-4f3a-9ca2-f8baaa3042ad None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:10.793852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:10.794921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:10.795869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 387/751] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:27:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:10.800854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:10.803925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:10.804863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:10.805208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:10.805567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:10.816905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:10.818514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:10.843142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:10.844130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 17:27:10.845062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:10.847702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 365/752] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:10.858573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:10.956272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497dc9-9ca3-49b4-9375-fb553dbac1ea None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:10.992548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86954eed-7c24-4f75-9e2f-2a2537c0aa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:10.993225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86954eed-7c24-4f75-9e2f-2a2537c0aa14 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:10.993501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86954eed-7c24-4f75-9e2f-2a2537c0aa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:10.993811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86954eed-7c24-4f75-9e2f-2a2537c0aa14 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:10.994650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86954eed-7c24-4f75-9e2f-2a2537c0aa14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:10.994951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86954eed-7c24-4f75-9e2f-2a2537c0aa14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:10.996691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86954eed-7c24-4f75-9e2f-2a2537c0aa14 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.005084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66855f2-0e0a-4a2b-828b-ef5f1d8d2384 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.015304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 388/753] 10.222.0.58 () {56 vars in 1149 bytes} [Mon May 16 17:27:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:11.016663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0f84-c21a-4870-a6c2-c9bbe5e51c0e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.016944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0f84-c21a-4870-a6c2-c9bbe5e51c0e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.017272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0f84-c21a-4870-a6c2-c9bbe5e51c0e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.018828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 389/754] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:11.021497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0f84-c21a-4870-a6c2-c9bbe5e51c0e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.050771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867310e-659e-4e19-b3a9-5c5364d276c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.051808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867310e-659e-4e19-b3a9-5c5364d276c8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.052082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867310e-659e-4e19-b3a9-5c5364d276c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.052360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867310e-659e-4e19-b3a9-5c5364d276c8 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.053221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867310e-659e-4e19-b3a9-5c5364d276c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:11.053518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867310e-659e-4e19-b3a9-5c5364d276c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.055040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867310e-659e-4e19-b3a9-5c5364d276c8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.073265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 366/755] 10.222.0.58 () {56 vars in 1135 bytes} [Mon May 16 17:27:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:11.074797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d564-3114-4dfe-8485-11a7b490118b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.075077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d564-3114-4dfe-8485-11a7b490118b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.075404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d564-3114-4dfe-8485-11a7b490118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.092511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3e16d564-3114-4dfe-8485-11a7b490118b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:11.093756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3e16d564-3114-4dfe-8485-11a7b490118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:11.134550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0f84-c21a-4870-a6c2-c9bbe5e51c0e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.169222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e7126-9858-496c-ae43-faf0cc335273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.169940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e7126-9858-496c-ae43-faf0cc335273 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.170263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e7126-9858-496c-ae43-faf0cc335273 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.170544 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e7126-9858-496c-ae43-faf0cc335273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.173816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 367/756] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:11.174773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d564-3114-4dfe-8485-11a7b490118b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.240126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e7126-9858-496c-ae43-faf0cc335273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.241667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e7126-9858-496c-ae43-faf0cc335273 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.292525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d564-3114-4dfe-8485-11a7b490118b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.328691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849145-7486-4e74-b144-65b2bcf6408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.329354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849145-7486-4e74-b144-65b2bcf6408d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.329661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849145-7486-4e74-b144-65b2bcf6408d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.329933 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849145-7486-4e74-b144-65b2bcf6408d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.342341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 390/757] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:11.343190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e7126-9858-496c-ae43-faf0cc335273 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.400452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd849145-7486-4e74-b144-65b2bcf6408d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.401957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd849145-7486-4e74-b144-65b2bcf6408d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.457824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e7126-9858-496c-ae43-faf0cc335273 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.493111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.494538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.494819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.495087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.495950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.498197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.500052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 368/758] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:11.501058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849145-7486-4e74-b144-65b2bcf6408d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:11.512818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:11.514633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:11.516194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 391/759] 10.222.0.58 () {56 vars in 1129 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:11.517655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.605986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849145-7486-4e74-b144-65b2bcf6408d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.640929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9cb7-195f-476d-9a09-50a11d82dd77 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.646047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.646857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.647130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.647396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.660903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.662664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.673891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.674792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.675135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.675468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:11.684745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:11.686365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:11.688294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:11.688294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:11.688294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:11.688294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:11.688294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 369/760] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:11.688923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.689073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.689211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:11.706407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:11.708435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:11.710611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:11.710611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:11.710611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:11.710611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:11.710611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 392/761] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:11.710611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.794774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d95863-9219-47cd-a966-53f812d09a7f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.820905 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e67d9-5ad3-43b1-804c-096c71f947e2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.827604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.828274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.828554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.828824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.829536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:11.829863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.831232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.840274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 370/762] 10.222.0.58 () {56 vars in 1124 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:11.840274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.860509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfd26b-0e15-4627-9b6e-bc794873dc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.861109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfd26b-0e15-4627-9b6e-bc794873dc85 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.861378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfd26b-0e15-4627-9b6e-bc794873dc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.861699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfd26b-0e15-4627-9b6e-bc794873dc85 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.862444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfd26b-0e15-4627-9b6e-bc794873dc85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:11.862749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfd26b-0e15-4627-9b6e-bc794873dc85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.864194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfd26b-0e15-4627-9b6e-bc794873dc85 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.881730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 393/763] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:11.881730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24891-a3a3-4604-b5e4-42921b22e453 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.881730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24891-a3a3-4604-b5e4-42921b22e453 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.881730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24891-a3a3-4604-b5e4-42921b22e453 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.881730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 394/764] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:11.881730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df24891-a3a3-4604-b5e4-42921b22e453 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:11.942019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15768268-5449-4932-9d3b-34129e5ed77c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.978961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:11.980158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:11.980449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:11.980748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:11.981590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:11.981982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:11.982799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df24891-a3a3-4604-b5e4-42921b22e453 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:11.983344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:11.995416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 371/765] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:11.996562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.019187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a53b1-621d-4821-8ab8-064ae42fb486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.019849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a53b1-621d-4821-8ab8-064ae42fb486 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.020129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a53b1-621d-4821-8ab8-064ae42fb486 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.020398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a53b1-621d-4821-8ab8-064ae42fb486 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.021106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a53b1-621d-4821-8ab8-064ae42fb486 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:12.021405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a53b1-621d-4821-8ab8-064ae42fb486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.022821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a53b1-621d-4821-8ab8-064ae42fb486 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.033445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 395/766] 10.222.0.58 () {56 vars in 1124 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:12.033445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cff5-45f3-490e-afb6-eaea5e66a68c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.033445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cff5-45f3-490e-afb6-eaea5e66a68c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.033445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cff5-45f3-490e-afb6-eaea5e66a68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.047844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3406cff5-45f3-490e-afb6-eaea5e66a68c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:12.049008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3406cff5-45f3-490e-afb6-eaea5e66a68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:12.094837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c34b6f-0282-4cf0-8002-bc6a25d91528 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.116376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 396/767] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:12.117136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406cff5-45f3-490e-afb6-eaea5e66a68c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.136564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.137502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.137833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.138103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.145054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.146537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:12.160951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:12.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:12.162808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 372/768] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:12.163304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.218918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406cff5-45f3-490e-afb6-eaea5e66a68c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.249871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda3029-158c-46e1-be58-6cb1ee560e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.250658 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3029-158c-46e1-be58-6cb1ee560e61 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.250935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3029-158c-46e1-be58-6cb1ee560e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.251205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3029-158c-46e1-be58-6cb1ee560e61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.256212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2cc45-1df7-4177-8e57-02752622d9a9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.257661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda3029-158c-46e1-be58-6cb1ee560e61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.259136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda3029-158c-46e1-be58-6cb1ee560e61 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-edda3029-158c-46e1-be58-6cb1ee560e61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:12.272672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:12.273593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:12.274507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 397/769] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:12.275458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ee03-8f7b-492a-b01a-b82fcedf7f1a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.275458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ee03-8f7b-492a-b01a-b82fcedf7f1a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.275590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ee03-8f7b-492a-b01a-b82fcedf7f1a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.277057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 398/770] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:12.278028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2ee03-8f7b-492a-b01a-b82fcedf7f1a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.291953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.292620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.292900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.293210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.294043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] RBAC: Adding query filter params (interface=public, service_id=7b7edb8b2ae949679885aabdc80a408e, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:12.294351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.295728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.303724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 373/771] 10.222.0.58 () {56 vars in 1251 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/endpoints?service_id=7b7edb8b2ae949679885aabdc80a408e&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:12.304635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.379895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2ee03-8f7b-492a-b01a-b82fcedf7f1a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.398350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfb92d-297c-4cc9-ad21-be4b9e3894ab None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.410701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.411488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.411759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.412023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] PATH_INFO: `/v3/services/network` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.412663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.414063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:12.425507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:12.426901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:12.427760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 399/772] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:12.428587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.432195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cbfd8-7e58-40b8-88a8-d0ca143e60b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.432850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbfd8-7e58-40b8-88a8-d0ca143e60b9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.433125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbfd8-7e58-40b8-88a8-d0ca143e60b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.433393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbfd8-7e58-40b8-88a8-d0ca143e60b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.434272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cbfd8-7e58-40b8-88a8-d0ca143e60b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:12.434574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cbfd8-7e58-40b8-88a8-d0ca143e60b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.435980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cbfd8-7e58-40b8-88a8-d0ca143e60b9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.447722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 374/773] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:12.448895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489be5b-b0c3-403a-bb09-a8bae310ce9e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.449175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489be5b-b0c3-403a-bb09-a8bae310ce9e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.449477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489be5b-b0c3-403a-bb09-a8bae310ce9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.466515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a489be5b-b0c3-403a-bb09-a8bae310ce9e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:12.467668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a489be5b-b0c3-403a-bb09-a8bae310ce9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:12.522662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d9496-ddab-4089-be50-98b8e12da748 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.530339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 375/774] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:12.531150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489be5b-b0c3-403a-bb09-a8bae310ce9e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.555675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.556360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.556670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.556931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.557799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:12.558128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.559719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.572660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 400/775] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:12.573511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.623598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489be5b-b0c3-403a-bb09-a8bae310ce9e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.656401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55bea9-71bd-422a-8087-5d0c3f7c7eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.656981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55bea9-71bd-422a-8087-5d0c3f7c7eae None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.657259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55bea9-71bd-422a-8087-5d0c3f7c7eae None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.657580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55bea9-71bd-422a-8087-5d0c3f7c7eae None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.658246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55bea9-71bd-422a-8087-5d0c3f7c7eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.659601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55bea9-71bd-422a-8087-5d0c3f7c7eae None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.664744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 376/776] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/services => generated 772 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:12.665404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55bea9-71bd-422a-8087-5d0c3f7c7eae None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.667118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476748b-48a7-483d-a8a3-47f6872159f5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.704834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.705515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.705829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.706098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.706808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] RBAC: Adding query filter params (name=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:12.707107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.708887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.713396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 401/777] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:12.719106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.769089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55bea9-71bd-422a-8087-5d0c3f7c7eae None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.803640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.804327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.804609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.804886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.805773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=8a71982b29f447899a3d06885cf237bd) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:12.806081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.807561 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.825598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 377/778] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/role_assignments?user.id=8a71982b29f447899a3d06885cf237bd&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:12.825598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.835057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e266a4-e0c5-4bd1-957a-caaff37d1971 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.874223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c1874-f3b3-46fd-8a3b-0b7e35af0570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.875020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c1874-f3b3-46fd-8a3b-0b7e35af0570 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.875806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c1874-f3b3-46fd-8a3b-0b7e35af0570 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.875806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c1874-f3b3-46fd-8a3b-0b7e35af0570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.892310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c1874-f3b3-46fd-8a3b-0b7e35af0570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f36c1874-f3b3-46fd-8a3b-0b7e35af0570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:12.900173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:12.901385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:12.902788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 402/779] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:12.906933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c1874-f3b3-46fd-8a3b-0b7e35af0570 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:12.942126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763336ff-a684-48ed-aa88-70b4c54b96a1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:12.984555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:12.985639 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:12.986052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:12.986602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:12.988172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=6f320795fd0b42319df94dbc171938b8) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:12.988627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:12.990267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:12.998896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 378/780] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/role_assignments?user.id=6f320795fd0b42319df94dbc171938b8&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:13.000082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:13.039866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c1874-f3b3-46fd-8a3b-0b7e35af0570 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:13.100259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:13.101736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:13.102017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:13.102291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:13.103017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] RBAC: Adding query filter params (type=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:13.106451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:13.107873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:13.119645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 403/781] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:13.125518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:13.170785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe658b5-b3d6-4705-a8e0-2ee39e8c7385 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:13.242440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:13.243308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:13.243696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:13.244063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:13.244940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:13.245342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:13.246930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:13.260466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 379/782] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:13.261143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3a89-cec9-4258-b834-d3b7ffa98552 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:13.266305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:13.309810 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:13.310525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:13.310806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:13.311082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:13.311884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] RBAC: Adding query filter params (interface=public, service_id=86826bdb7a7d401dac9454b140ec850a, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:13.312190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:13.313668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:13.322143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 404/783] 10.222.0.58 () {56 vars in 1251 bytes} [Mon May 16 17:27:13 2022] GET /identity/v3/endpoints?service_id=86826bdb7a7d401dac9454b140ec850a&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:13.327936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:13.380746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcf59-6693-4282-9c48-6c69b3b5db16 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:13.413840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:13.414747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:13.415096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:13.415435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:13.426552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:13.428045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:13.445319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:13.446325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:13.447238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:13.447238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:13.447238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:13.447238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:13.447238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 380/784] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:13.452590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:13.459470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b871-b517-440c-bed3-435466aae3d5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:13.515006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca0a61-0537-4a03-aff5-2e978af5b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:13.516021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0a61-0537-4a03-aff5-2e978af5b093 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:13.516518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0a61-0537-4a03-aff5-2e978af5b093 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:13.516964 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0a61-0537-4a03-aff5-2e978af5b093 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:13.517855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca0a61-0537-4a03-aff5-2e978af5b093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:13.519418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca0a61-0537-4a03-aff5-2e978af5b093 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:13.530587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 405/785] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:27:13 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:13.588150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491094dd-e3b5-426b-800b-dc7401a7da94 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:13.624576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:13.625608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:13.626068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:13.626514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:13.627447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:13.627923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:13.629485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:13.643139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 381/786] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:13.650712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca0a61-0537-4a03-aff5-2e978af5b093 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:13.772227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca0a61-0537-4a03-aff5-2e978af5b093 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:13.814073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:13.814961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:13.815230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:13.815506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:13.824421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:13.826015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:13.842025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:13.843110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:13.844342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 406/787] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:27:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:13.850986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:13.959916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ed1d6-5ca0-4baf-b3fa-775ccc78ca47 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:13.998039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:13.998841 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:13.999121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:13.999397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:14.000288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:14.000598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:14.002159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:14.021846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 382/788] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:27:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:14.027662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:14.140488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61454395-caf9-49fb-98f4-a71e31b504c9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:14.178989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54160c72-2cd6-436c-8ff1-69f71bf0ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:14.179844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54160c72-2cd6-436c-8ff1-69f71bf0ff7d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:14.180161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54160c72-2cd6-436c-8ff1-69f71bf0ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:14.180436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54160c72-2cd6-436c-8ff1-69f71bf0ff7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:14.250850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54160c72-2cd6-436c-8ff1-69f71bf0ff7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:14.252320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54160c72-2cd6-436c-8ff1-69f71bf0ff7d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:14.347515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 407/789] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:14.352667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:14.509119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9e516-76b5-4625-aa3d-a499f750a345 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:14.546737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:14.547558 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:14.547876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:14.548236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:14.560027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:14.561484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:14.581427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:14.582395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:14.584142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:14.584142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:14.584142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:14.584142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:14.584142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 383/790] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:14.594691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54160c72-2cd6-436c-8ff1-69f71bf0ff7d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:14.719117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54160c72-2cd6-436c-8ff1-69f71bf0ff7d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:14.753458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:14.754161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:14.754440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:14.754710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:14.755434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:14.755733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:14.757103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:14.768842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 408/791] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:14.774066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:14.922961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6be59d-d951-4a8e-8f6a-6644bef39e2f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:14.969066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:14.969973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:14.970198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:14.970473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:14.977811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:14.979276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:15.011244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:15.013429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:15.015589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 384/792] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:15.018516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:15.169321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fd89c-019f-4555-b9a5-f277322726fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:15.215635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff181c-c5d4-4528-8035-4cf01c58e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:15.216309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff181c-c5d4-4528-8035-4cf01c58e083 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.216593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff181c-c5d4-4528-8035-4cf01c58e083 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.216866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff181c-c5d4-4528-8035-4cf01c58e083 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.217681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff181c-c5d4-4528-8035-4cf01c58e083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:15.217986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff181c-c5d4-4528-8035-4cf01c58e083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:15.219603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff181c-c5d4-4528-8035-4cf01c58e083 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:15.236568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 409/793] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:15.242035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:15.309019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aa64c-827d-47c3-9c41-9e5473436376 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.309379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aa64c-827d-47c3-9c41-9e5473436376 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.309587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aa64c-827d-47c3-9c41-9e5473436376 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.311805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 410/794] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:15.317819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131d2f-1f52-4fd1-a2d5-aa9ae5e430e6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.318138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131d2f-1f52-4fd1-a2d5-aa9ae5e430e6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.318363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131d2f-1f52-4fd1-a2d5-aa9ae5e430e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.353051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ab131d2f-1f52-4fd1-a2d5-aa9ae5e430e6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:15.357037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ab131d2f-1f52-4fd1-a2d5-aa9ae5e430e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:15.394389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692a266-d017-40f5-82f0-ab5a25227772 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:15.435426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:15.436471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.436994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.437457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.438508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=a7263b80be2c437997b1a18002c9969d) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:15.439012 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:15.440709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:15.447418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 385/795] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:15 2022] GET /identity/v3/role_assignments?user.id=a7263b80be2c437997b1a18002c9969d&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:15.484297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 411/796] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:15.508202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:15.519265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68763-097b-4a28-9590-b414080eab41 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.519614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68763-097b-4a28-9590-b414080eab41 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.519874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68763-097b-4a28-9590-b414080eab41 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.521659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 412/797] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:15.527283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e287db-4e99-4842-ab3f-9eeef80111c1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.527641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e287db-4e99-4842-ab3f-9eeef80111c1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.528310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e287db-4e99-4842-ab3f-9eeef80111c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.545982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-88e287db-4e99-4842-ab3f-9eeef80111c1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:15.547383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-88e287db-4e99-4842-ab3f-9eeef80111c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:15.626679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 413/798] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:15.657929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9f6dd-4fd5-47a4-94ac-d1d1b93c5b36 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:15.684042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e287db-4e99-4842-ab3f-9eeef80111c1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:15.699529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:15.700432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.700712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.700995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.701680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:15.703062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:15.717645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:15.718660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:15.719520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 386/799] 10.222.0.58 () {56 vars in 1129 bytes} [Mon May 16 17:27:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:15.730670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:15.796831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e287db-4e99-4842-ab3f-9eeef80111c1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:15.832422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da073b-b338-4b09-ac6c-2c262f5469d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:15.832781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45012843-c0b6-41e0-8768-424301e84443 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:15.833215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da073b-b338-4b09-ac6c-2c262f5469d7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.833488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da073b-b338-4b09-ac6c-2c262f5469d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.833784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da073b-b338-4b09-ac6c-2c262f5469d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.845815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da073b-b338-4b09-ac6c-2c262f5469d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c0da073b-b338-4b09-ac6c-2c262f5469d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:15.853418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:15.855376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:15.856515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 414/800] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:27:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:15.862090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da073b-b338-4b09-ac6c-2c262f5469d7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:15.873355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:15.874531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:15.874813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:15.875085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:15.876203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:15.876501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:15.877992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:15.884471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 387/801] 10.222.0.58 () {56 vars in 1124 bytes} [Mon May 16 17:27:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:15.889830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:15.983858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da073b-b338-4b09-ac6c-2c262f5469d7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.019829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7991d-9293-43bb-8b9d-d18ff99f4a11 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.021435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae75e-7f46-48ea-8427-63ac31dc9972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.022151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae75e-7f46-48ea-8427-63ac31dc9972 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.022424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae75e-7f46-48ea-8427-63ac31dc9972 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.022685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae75e-7f46-48ea-8427-63ac31dc9972 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.023427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae75e-7f46-48ea-8427-63ac31dc9972 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:16.023724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae75e-7f46-48ea-8427-63ac31dc9972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:16.025094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae75e-7f46-48ea-8427-63ac31dc9972 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:16.043387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 415/802] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:27:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:16.045084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2cc4d-1660-4dc4-b40c-797790dbf6f7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.045617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2cc4d-1660-4dc4-b40c-797790dbf6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.046123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2cc4d-1660-4dc4-b40c-797790dbf6f7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.047906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 416/803] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:16.052856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2cc4d-1660-4dc4-b40c-797790dbf6f7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:16.061745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157960-c655-449f-b783-60f350f75ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.062420 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157960-c655-449f-b783-60f350f75ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.062694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157960-c655-449f-b783-60f350f75ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.062962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157960-c655-449f-b783-60f350f75ff1 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.063684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157960-c655-449f-b783-60f350f75ff1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:16.063990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157960-c655-449f-b783-60f350f75ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:16.065466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157960-c655-449f-b783-60f350f75ff1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:16.070920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 388/804] 10.222.0.58 () {56 vars in 1124 bytes} [Mon May 16 17:27:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:16.072235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b73920-67d7-443d-aa9c-78c913c431ee None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.072500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b73920-67d7-443d-aa9c-78c913c431ee None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.072767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b73920-67d7-443d-aa9c-78c913c431ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.089278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-10b73920-67d7-443d-aa9c-78c913c431ee None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:16.090522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-10b73920-67d7-443d-aa9c-78c913c431ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:16.165570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 389/805] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:16.165570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b73920-67d7-443d-aa9c-78c913c431ee None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:16.166849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2cc4d-1660-4dc4-b40c-797790dbf6f7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.218380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.219919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.220388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.220896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.231676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:16.233397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:16.250471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:16.251383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:16.252263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:16.252263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:16.252263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:16.252263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:16.254465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 417/806] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:16.255435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:16.264752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b73920-67d7-443d-aa9c-78c913c431ee None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.298912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fa3a-8646-404e-8d7e-31cd73f1ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.299497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fa3a-8646-404e-8d7e-31cd73f1ab6f None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.299807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fa3a-8646-404e-8d7e-31cd73f1ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.300034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fa3a-8646-404e-8d7e-31cd73f1ab6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.300845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fa3a-8646-404e-8d7e-31cd73f1ab6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:16.302572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fa3a-8646-404e-8d7e-31cd73f1ab6f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:16.327037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 390/807] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:27:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:16.328914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fa3a-8646-404e-8d7e-31cd73f1ab6f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:16.373499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8606d-541c-440b-9275-c2b70669649e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.421726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f41d6-78fe-4ff3-b054-d80f800339af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.422535 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f41d6-78fe-4ff3-b054-d80f800339af None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.422808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f41d6-78fe-4ff3-b054-d80f800339af None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.423073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f41d6-78fe-4ff3-b054-d80f800339af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.449797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f41d6-78fe-4ff3-b054-d80f800339af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8b6f41d6-78fe-4ff3-b054-d80f800339af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:16.464316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:16.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:16.466280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:16.470683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 418/808] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:16.478259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f41d6-78fe-4ff3-b054-d80f800339af None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:16.490750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fa3a-8646-404e-8d7e-31cd73f1ab6f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.549609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.550632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.551432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.551898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.552931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:16.553429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:16.556446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:16.583958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 391/809] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:16.589467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:16.636874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f41d6-78fe-4ff3-b054-d80f800339af None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.672617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1cfd3-a806-4e70-83fa-78b64ae57163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.673912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1cfd3-a806-4e70-83fa-78b64ae57163 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.673912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1cfd3-a806-4e70-83fa-78b64ae57163 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.673912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1cfd3-a806-4e70-83fa-78b64ae57163 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.674563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1cfd3-a806-4e70-83fa-78b64ae57163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:16.674862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1cfd3-a806-4e70-83fa-78b64ae57163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:16.676555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1cfd3-a806-4e70-83fa-78b64ae57163 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:16.687705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 419/810] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:16.687705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b7665-e382-4a48-88eb-82c8dd0b8600 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.687954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b7665-e382-4a48-88eb-82c8dd0b8600 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.688054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b7665-e382-4a48-88eb-82c8dd0b8600 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.689475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 420/811] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:16.694261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b7665-e382-4a48-88eb-82c8dd0b8600 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:16.714988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80bba-557f-4a99-b696-b4ba6164783f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.748352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61f5c6-47f5-4986-b56b-324c9d8eb863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.749171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f5c6-47f5-4986-b56b-324c9d8eb863 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.749680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f5c6-47f5-4986-b56b-324c9d8eb863 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.749883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f5c6-47f5-4986-b56b-324c9d8eb863 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.757218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61f5c6-47f5-4986-b56b-324c9d8eb863 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:16.758916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61f5c6-47f5-4986-b56b-324c9d8eb863 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ca61f5c6-47f5-4986-b56b-324c9d8eb863 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:16.774186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:16.775142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:16.776640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 392/812] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:27:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:16.777229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d3923-a03c-4ab0-b696-eae7958f3a1a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.777229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d3923-a03c-4ab0-b696-eae7958f3a1a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.777229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d3923-a03c-4ab0-b696-eae7958f3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.793522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-801d3923-a03c-4ab0-b696-eae7958f3a1a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:16.794717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-801d3923-a03c-4ab0-b696-eae7958f3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:16.821527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b7665-e382-4a48-88eb-82c8dd0b8600 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:16.862367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:16.864366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:16.864652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:16.864921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:16.881703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:16.883599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:16.889640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 393/813] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:16.890529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d3923-a03c-4ab0-b696-eae7958f3a1a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:16.902948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:16.903914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:16.904835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:16.904835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:16.904835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:16.904835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:16.912229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 421/814] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:16.914079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.024222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd907e-0aea-4a68-ba90-ee451d03f729 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.031639 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d3923-a03c-4ab0-b696-eae7958f3a1a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.061171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.062219 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.062490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.062764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.063757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:17.064062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.065918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.079769 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 422/815] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:17.080324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.080578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.081495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.081977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.082467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.084554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:17.085072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.086737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.106712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 394/816] 10.222.0.58 () {56 vars in 1149 bytes} [Mon May 16 17:27:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:17.107818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.203191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa34bf8-e5cf-499f-bfce-8cb67ccd0f26 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.206471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78f619-8b50-48ce-9b62-1abae94e9a7c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.240323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.241440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.242033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.242545 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.243400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.244264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.244634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.244969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.245867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.247854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.251450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.253064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:17.260842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:17.261937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:17.262794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 423/817] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:17.263579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:17.271552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:17.272526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 17:27:17.273475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:17.276195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 395/818] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:17.277145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.386204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f44c0c-d1be-4340-a4ec-1fa523d762ac None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.390156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381d038-315a-4510-a869-5cf347c4aba1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.422885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.424321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.425062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.425622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.426824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:17.427331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.429028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.429472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.430547 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.430930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.431295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.435356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 396/819] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:17.436394 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.443780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.445338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:17.466798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:17.467697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:17.468603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:17.468603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:17.468603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:17.468603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:17.472683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 424/820] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:17.473679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.561602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fc17-fd03-40fb-abe2-da4eddc4a8e4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.574263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0d5a1-bd6f-498a-a693-8366f1c38fab None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.603198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.604158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.604452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.604726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.605664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:17.605973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.607413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.607987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.608747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.609120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.609483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.610303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:17.610701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.612203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.617950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 425/821] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:17.618911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.628174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 397/822] 10.222.0.58 () {56 vars in 1135 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:17.629027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.731293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7904-bbf9-418c-bdfb-a35fd56c4aa2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.735939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303e730-779c-40c9-b9d1-4d40423328e1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:17.764416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.765080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.765353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.765649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.766366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:17.766664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.768024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.770493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03b68e-2678-4094-b1db-6a5769a2ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:17.771151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b68e-2678-4094-b1db-6a5769a2ba62 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:17.771427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b68e-2678-4094-b1db-6a5769a2ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:17.771696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b68e-2678-4094-b1db-6a5769a2ba62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:17.772427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03b68e-2678-4094-b1db-6a5769a2ba62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:17.773797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03b68e-2678-4094-b1db-6a5769a2ba62 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:17.780208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 426/823] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:17.781085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.795561 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 398/824] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:27:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:17.796462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03b68e-2678-4094-b1db-6a5769a2ba62 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:17.988724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03b68e-2678-4094-b1db-6a5769a2ba62 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.001511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15a5e0-1c7a-489d-90f1-3b80cd840023 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.026763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.027923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.028486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.028904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.038281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.039861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:18.060023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:18.060988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:18.061904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:18.061904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:18.061904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:18.061904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:18.061904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:18.061904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:18.061904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:18.061904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:18.062339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.062339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.062339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.062738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 399/825] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:18.063042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.068250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.079718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.081214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:18.109289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:18.110250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:18.111127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:18.111127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:18.111127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:18.111127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:18.117333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 427/826] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:18.118290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.198638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278baf3-d904-4676-9059-a8c42b0b7a69 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.230933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f3e7d-e9ec-4579-83b0-860ff1878863 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.232631 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c887ead-98ca-4730-b87f-c0bd571bb9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.233327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c887ead-98ca-4730-b87f-c0bd571bb9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.233638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c887ead-98ca-4730-b87f-c0bd571bb9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.233915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c887ead-98ca-4730-b87f-c0bd571bb9d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.234716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c887ead-98ca-4730-b87f-c0bd571bb9d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:18.235017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c887ead-98ca-4730-b87f-c0bd571bb9d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.236620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c887ead-98ca-4730-b87f-c0bd571bb9d7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.248363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 400/827] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:18.249712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b5eb7-4635-40d4-b22c-6782bc641b32 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.249994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b5eb7-4635-40d4-b22c-6782bc641b32 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.250266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b5eb7-4635-40d4-b22c-6782bc641b32 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.251643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 401/828] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:18.253856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b5eb7-4635-40d4-b22c-6782bc641b32 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.272009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c155b4-e256-4daa-8584-a3d617fb4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.272762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c155b4-e256-4daa-8584-a3d617fb4c19 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.273042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c155b4-e256-4daa-8584-a3d617fb4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.273311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c155b4-e256-4daa-8584-a3d617fb4c19 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.274067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c155b4-e256-4daa-8584-a3d617fb4c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:18.274363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c155b4-e256-4daa-8584-a3d617fb4c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.275714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c155b4-e256-4daa-8584-a3d617fb4c19 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.286634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 428/829] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:18.287816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad48d3c-6ef2-40de-ba44-1d6f7e02e371 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.288095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad48d3c-6ef2-40de-ba44-1d6f7e02e371 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.288365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad48d3c-6ef2-40de-ba44-1d6f7e02e371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.305998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bad48d3c-6ef2-40de-ba44-1d6f7e02e371 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:18.307151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bad48d3c-6ef2-40de-ba44-1d6f7e02e371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:18.373805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b5eb7-4635-40d4-b22c-6782bc641b32 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.374153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 429/830] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:18.374153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad48d3c-6ef2-40de-ba44-1d6f7e02e371 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.410541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf1ad-6da8-4c8a-a9ec-5b0a312685c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.411436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf1ad-6da8-4c8a-a9ec-5b0a312685c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.411706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf1ad-6da8-4c8a-a9ec-5b0a312685c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.412004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf1ad-6da8-4c8a-a9ec-5b0a312685c5 None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/8a71982b29f447899a3d06885cf237bd/roles/117a8af4218c4823b9f45e58df8c8be1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.426950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdf1ad-6da8-4c8a-a9ec-5b0a312685c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=8a71982b29f447899a3d06885cf237bd, role_id=117a8af4218c4823b9f45e58df8c8be1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.428396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdf1ad-6da8-4c8a-a9ec-5b0a312685c5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.441253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 402/831] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:27:18 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/8a71982b29f447899a3d06885cf237bd/roles/117a8af4218c4823b9f45e58df8c8be1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:27:18.442097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf1ad-6da8-4c8a-a9ec-5b0a312685c5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.496618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad48d3c-6ef2-40de-ba44-1d6f7e02e371 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.533445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.534251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.534535 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.535182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.542542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.544073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:18.560082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:18.561235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:18.562337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:18.562337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:18.562337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:18.562337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:18.562337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:18.562337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:18.562337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:18.562337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:18.564378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf1ad-6da8-4c8a-a9ec-5b0a312685c5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.566284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 430/832] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:18.567194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.601777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.602920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.603402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.603843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.604738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.606453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:18.619580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:18.620625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:18.621652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:18.624306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 403/833] 10.222.0.58 () {56 vars in 1132 bytes} [Mon May 16 17:27:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:18.629900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.680922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eada8-fd52-42d3-87e8-fb696e86da5a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.726161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.727354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.728283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.728679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.729584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:18.730100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.732293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.748236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 431/834] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:18.750702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9866fdc-1f3a-4d27-a0cc-74adb6c9c7a1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.755615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.798691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.800812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.801599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.802014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.802931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:18.803376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.805819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.811907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 404/835] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:18.817025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:18.866486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec42c4-13a7-4b55-a576-5c4478ae677e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.901094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34dbd2-bb74-478b-a3fd-8e4412c0b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.902034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34dbd2-bb74-478b-a3fd-8e4412c0b10c None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.902577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34dbd2-bb74-478b-a3fd-8e4412c0b10c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.902698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34dbd2-bb74-478b-a3fd-8e4412c0b10c None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/6f320795fd0b42319df94dbc171938b8/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.904558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34dbd2-bb74-478b-a3fd-8e4412c0b10c None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=6f320795fd0b42319df94dbc171938b8, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.906046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34dbd2-bb74-478b-a3fd-8e4412c0b10c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.917121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f031b66-ce05-45ce-b558-c0b255ac9614 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:18.919651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 432/836] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:27:18 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/6f320795fd0b42319df94dbc171938b8/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:27:18.920998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919d55-791d-4609-8a35-c338fed31773 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.921286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919d55-791d-4609-8a35-c338fed31773 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.921586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919d55-791d-4609-8a35-c338fed31773 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.927737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 433/837] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:18.931892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719a60-818f-4e0f-bf36-408df398db74 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.932558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719a60-818f-4e0f-bf36-408df398db74 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.933060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719a60-818f-4e0f-bf36-408df398db74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.959882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-03719a60-818f-4e0f-bf36-408df398db74 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:18.962235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-03719a60-818f-4e0f-bf36-408df398db74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:18.965411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:18.966953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:18.966953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:18.966953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:18.967863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:18.968261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:18.969817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:18.975601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 405/838] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:19.052180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 434/839] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:19.074645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:19.191017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab31ed-7d5c-4868-805c-21665c1b5857 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:19.227114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:19.227918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:19.228196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:19.228464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:19.229116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:19.230552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:19.242238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:19.243270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:19.244112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 406/840] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:19.251010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719a60-818f-4e0f-bf36-408df398db74 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:19.347346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719a60-818f-4e0f-bf36-408df398db74 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:19.381020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe2efd-dd16-4c11-8a68-1d87b34992f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:19.382012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe2efd-dd16-4c11-8a68-1d87b34992f0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:19.382430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe2efd-dd16-4c11-8a68-1d87b34992f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:19.382838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe2efd-dd16-4c11-8a68-1d87b34992f0 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:19.383779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe2efd-dd16-4c11-8a68-1d87b34992f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:19.384225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe2efd-dd16-4c11-8a68-1d87b34992f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:19.385753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe2efd-dd16-4c11-8a68-1d87b34992f0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:19.390788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 435/841] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:19.397344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:19.507123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d765ec-2d13-46d6-a215-8cf4d50818e2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:19.542472 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50db55-2d1d-439a-86c2-fe5d6009502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:19.543506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50db55-2d1d-439a-86c2-fe5d6009502b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:19.543958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50db55-2d1d-439a-86c2-fe5d6009502b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:19.544399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50db55-2d1d-439a-86c2-fe5d6009502b None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:19.545359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50db55-2d1d-439a-86c2-fe5d6009502b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:19.545853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50db55-2d1d-439a-86c2-fe5d6009502b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:19.547413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50db55-2d1d-439a-86c2-fe5d6009502b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:19.552934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 407/842] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:20.747162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9cad4-7551-4924-b1ce-e88389bb6cb7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:20.747691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9cad4-7551-4924-b1ce-e88389bb6cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:20.747691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9cad4-7551-4924-b1ce-e88389bb6cb7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:20.749324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 436/843] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:20.755018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb783f8-24ff-4db1-ac5b-6587e432a326 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:20.755487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb783f8-24ff-4db1-ac5b-6587e432a326 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:20.755567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb783f8-24ff-4db1-ac5b-6587e432a326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:20.772733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cbb783f8-24ff-4db1-ac5b-6587e432a326 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:20.773964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cbb783f8-24ff-4db1-ac5b-6587e432a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:20.845668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 408/844] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:20.864125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9cad4-7551-4924-b1ce-e88389bb6cb7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:20.963000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9cad4-7551-4924-b1ce-e88389bb6cb7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:20.995787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2426ea-3928-4705-ab8b-91a973ddef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:20.996655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2426ea-3928-4705-ab8b-91a973ddef31 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:20.996930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2426ea-3928-4705-ab8b-91a973ddef31 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:20.997248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2426ea-3928-4705-ab8b-91a973ddef31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.006988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2426ea-3928-4705-ab8b-91a973ddef31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5e2426ea-3928-4705-ab8b-91a973ddef31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:21.014576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:21.015488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:21.016336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 437/845] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:21.021812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb783f8-24ff-4db1-ac5b-6587e432a326 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.130108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb783f8-24ff-4db1-ac5b-6587e432a326 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:21.163763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf050e9-7f72-4081-b5c3-6132033300fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:21.164441 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf050e9-7f72-4081-b5c3-6132033300fc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.164722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf050e9-7f72-4081-b5c3-6132033300fc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.164995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf050e9-7f72-4081-b5c3-6132033300fc None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.165782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf050e9-7f72-4081-b5c3-6132033300fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:21.166088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf050e9-7f72-4081-b5c3-6132033300fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:21.167465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf050e9-7f72-4081-b5c3-6132033300fc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:21.180490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 409/846] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:27:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:21.181861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2426ea-3928-4705-ab8b-91a973ddef31 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.254016 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acd7bd-c6bc-44f4-86f7-ea7301adce80 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.254333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acd7bd-c6bc-44f4-86f7-ea7301adce80 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.254514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acd7bd-c6bc-44f4-86f7-ea7301adce80 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.256171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 410/847] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:21.258427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad319-a8ed-4bbe-b031-1d302211ab1c None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.258829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad319-a8ed-4bbe-b031-1d302211ab1c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.259204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad319-a8ed-4bbe-b031-1d302211ab1c None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.260739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 411/848] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:21.262872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fa21c-4208-498b-8d7f-f45d043eda4a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.263156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fa21c-4208-498b-8d7f-f45d043eda4a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.263430 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fa21c-4208-498b-8d7f-f45d043eda4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.281124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1b2fa21c-4208-498b-8d7f-f45d043eda4a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:21.282327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1b2fa21c-4208-498b-8d7f-f45d043eda4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:21.286164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2426ea-3928-4705-ab8b-91a973ddef31 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:21.318047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:21.318835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.319105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.319368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.330013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:21.331464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:21.348044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:21.349006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:21.354759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:21.354759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:21.354759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:21.354759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:21.354983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 412/849] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:21.354983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da57c-a01f-4a07-b4ec-bf9a00f9dc0e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.354983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da57c-a01f-4a07-b4ec-bf9a00f9dc0e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.354983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da57c-a01f-4a07-b4ec-bf9a00f9dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.361839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 438/850] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:21.363001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.372557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-178da57c-a01f-4a07-b4ec-bf9a00f9dc0e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:21.373349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-178da57c-a01f-4a07-b4ec-bf9a00f9dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:21.438931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 413/851] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:21.441764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178da57c-a01f-4a07-b4ec-bf9a00f9dc0e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.476184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d522cf-edb4-4c7f-924a-f59ba6989bdb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:21.510735 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:21.511345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.511681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.511954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.512674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:21.512975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:21.514377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:21.526490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 439/852] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:21.531314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.549633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178da57c-a01f-4a07-b4ec-bf9a00f9dc0e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:21.581482 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2c74b-f2f6-4621-a529-dbce6b3d8770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:21.582167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c74b-f2f6-4621-a529-dbce6b3d8770 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.582443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c74b-f2f6-4621-a529-dbce6b3d8770 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.582713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c74b-f2f6-4621-a529-dbce6b3d8770 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.583425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2c74b-f2f6-4621-a529-dbce6b3d8770 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:21.584788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2c74b-f2f6-4621-a529-dbce6b3d8770 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:21.598905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 414/853] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:27:21 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:21.600126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2c74b-f2f6-4621-a529-dbce6b3d8770 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.656142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17beb-c78d-473c-ad4f-be78bff49054 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:21.711073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69d31-dfb2-42c4-8b12-bec1e09c7e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:21.711943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69d31-dfb2-42c4-8b12-bec1e09c7e27 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.712224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69d31-dfb2-42c4-8b12-bec1e09c7e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.712495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69d31-dfb2-42c4-8b12-bec1e09c7e27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.717108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2c74b-f2f6-4621-a529-dbce6b3d8770 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:21.726847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba69d31-dfb2-42c4-8b12-bec1e09c7e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-fba69d31-dfb2-42c4-8b12-bec1e09c7e27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:21.737025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:21.738087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:21.738959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:21.741719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 440/854] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:21.745480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69d31-dfb2-42c4-8b12-bec1e09c7e27 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.759859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:21.760690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.761021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.761241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.769703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:21.771548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:21.786795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:21.787821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:21.788803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:21.792831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 415/855] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:27:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:21.793773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.861504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69d31-dfb2-42c4-8b12-bec1e09c7e27 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:21.894930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aa362-74f1-4d50-93e6-502a7318c221 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:21.895931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493a3b-1c71-46a8-acb0-b27ddaa70dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:21.896608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493a3b-1c71-46a8-acb0-b27ddaa70dda None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.896887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493a3b-1c71-46a8-acb0-b27ddaa70dda None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.897164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493a3b-1c71-46a8-acb0-b27ddaa70dda None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.897938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493a3b-1c71-46a8-acb0-b27ddaa70dda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:21.898244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493a3b-1c71-46a8-acb0-b27ddaa70dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:21.899644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493a3b-1c71-46a8-acb0-b27ddaa70dda None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:21.908201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 441/856] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:21.909278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8565a-6d8d-4207-b407-f0534bdbbd16 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.909577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8565a-6d8d-4207-b407-f0534bdbbd16 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.909865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8565a-6d8d-4207-b407-f0534bdbbd16 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.915001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 442/857] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:21.915001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8565a-6d8d-4207-b407-f0534bdbbd16 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:21.930606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded567a-49c7-4c99-8929-71d01c9df819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:21.931281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded567a-49c7-4c99-8929-71d01c9df819 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.931562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded567a-49c7-4c99-8929-71d01c9df819 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.931833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded567a-49c7-4c99-8929-71d01c9df819 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.932673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded567a-49c7-4c99-8929-71d01c9df819 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:21.933008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded567a-49c7-4c99-8929-71d01c9df819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:21.934594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded567a-49c7-4c99-8929-71d01c9df819 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:21.956346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 416/858] 10.222.0.58 () {56 vars in 1149 bytes} [Mon May 16 17:27:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:21.956346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf27a-4bb9-476b-8340-1308b1312863 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:21.956346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf27a-4bb9-476b-8340-1308b1312863 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:21.956346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf27a-4bb9-476b-8340-1308b1312863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:21.970087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4a3bf27a-4bb9-476b-8340-1308b1312863 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:21.971253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4a3bf27a-4bb9-476b-8340-1308b1312863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:22.028258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8565a-6d8d-4207-b407-f0534bdbbd16 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.049762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 417/859] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:21 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:22.049762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf27a-4bb9-476b-8340-1308b1312863 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.075070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.075863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.076144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.076417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.086774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.088239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:22.104903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:22.106098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:22.107309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:22.107309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:22.107309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:22.107309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:22.110921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 443/860] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:22.111573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.140979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf27a-4bb9-476b-8340-1308b1312863 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.187788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125d1d-c4c2-4dd2-a5a8-46ea8bba305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.188450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125d1d-c4c2-4dd2-a5a8-46ea8bba305f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.188731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125d1d-c4c2-4dd2-a5a8-46ea8bba305f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.189007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125d1d-c4c2-4dd2-a5a8-46ea8bba305f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.230479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8680c-37c6-4115-bdda-9fcbe11e870c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.258286 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125d1d-c4c2-4dd2-a5a8-46ea8bba305f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.260324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125d1d-c4c2-4dd2-a5a8-46ea8bba305f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.264463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aa2b2-bd84-4269-aed4-87b6ac733ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.265163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa2b2-bd84-4269-aed4-87b6ac733ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.265446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa2b2-bd84-4269-aed4-87b6ac733ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.265754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa2b2-bd84-4269-aed4-87b6ac733ae7 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.266472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aa2b2-bd84-4269-aed4-87b6ac733ae7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.267821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aa2b2-bd84-4269-aed4-87b6ac733ae7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.282352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 444/861] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:27:22 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:22.282888 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aa2b2-bd84-4269-aed4-87b6ac733ae7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.384039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 418/862] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:22.391476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125d1d-c4c2-4dd2-a5a8-46ea8bba305f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.409063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aa2b2-bd84-4269-aed4-87b6ac733ae7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.445308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.446008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.446354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.446565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.447314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:22.447617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.449093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.467608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 445/863] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:22.468594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.509508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125d1d-c4c2-4dd2-a5a8-46ea8bba305f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.555825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.557045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.557722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.558196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.571531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.573710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.589136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbc40d-302b-4900-8734-bc2e0e9eead3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:22.595575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:22.596479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:22.597385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:22.597385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:22.597385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:22.597385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:22.603711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 419/864] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:22.605780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.637897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.639797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.640306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.640786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.649954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.652306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:22.670532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:22.671608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 17:27:22.672567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:22.675660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 446/865] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:22.681243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.710225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756956e-7125-4773-81f7-1bd57339e272 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.744462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.745402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.745916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.746363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.747255 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:22.747727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.749287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.765601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 420/866] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:22.767515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.778704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681df0-9aaf-4b8e-9bf5-21d77e89a825 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.815010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.815613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.815886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.816159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.816991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:22.817298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.818766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.836907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 447/867] 10.222.0.58 () {56 vars in 1135 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:22.842989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.872903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34026ab1-144e-480c-919b-ac94a7464721 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.906688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.907765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.908187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.908601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:22.915797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:22.917569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:22.932522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:22.933497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:22.934584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:22.934584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:22.934584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:22.934584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:22.934584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:22.934584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:22.934584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:22.934584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:22.941051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5bf7-1bfb-4c23-bebf-dc6972359fc3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:22.941612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 421/868] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:22.942925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:22.974417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32529a4-c956-4707-bf42-fc056cf2c2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:22.975050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32529a4-c956-4707-bf42-fc056cf2c2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:22.975328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32529a4-c956-4707-bf42-fc056cf2c2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:22.975598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32529a4-c956-4707-bf42-fc056cf2c2f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.041007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32529a4-c956-4707-bf42-fc056cf2c2f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:23.041964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27894d-59af-460d-9fc7-aa9c00077ec9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:23.042532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32529a4-c956-4707-bf42-fc056cf2c2f3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:23.076534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:23.077454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.077902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.078315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.079262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:23.079710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:23.081383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:23.098487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 422/869] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:23.099907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:23.144790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 448/870] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:22 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:23.145691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32529a4-c956-4707-bf42-fc056cf2c2f3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:23.201540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca916f4e-eddf-409d-a35c-546ca7e9c07d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:23.236107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:23.237617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.238062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.238615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.240021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=8a71982b29f447899a3d06885cf237bd) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:23.240578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:23.242003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32529a4-c956-4707-bf42-fc056cf2c2f3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:23.242364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:23.257610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 423/871] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:23 2022] GET /identity/v3/role_assignments?user.id=8a71982b29f447899a3d06885cf237bd&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:23.284074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:23.284892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.285165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.285438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.298105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:23.299580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:23.319164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:23.320134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:23.321497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:23.321497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:23.321497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:23.321497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:23.321497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 449/872] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:23.326707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:23.430610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e70a-8ea0-45e5-ad48-25fcb19be273 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:23.473118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:23.474200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.474681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.475191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.476117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:23.476629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:23.478222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:23.492488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 424/873] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:23.498457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:23.612408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b997-281f-41b8-8c69-e3000a06e2ce None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:23.646830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:23.648004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.648482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.648951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.656081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:23.657792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:23.671542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:23.672452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:23.673358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:23.673358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:23.673358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:23.673358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:23.673358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:23.673358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:23.673358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:23.673358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:23.680644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 450/874] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:23.682245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:23.793111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0e472-cb4c-4f8d-a5c3-fa9b93becb7e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:23.826813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7953e2b-4a55-41be-beaa-0393b167adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:23.827474 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953e2b-4a55-41be-beaa-0393b167adcd None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.827751 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953e2b-4a55-41be-beaa-0393b167adcd None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.828024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953e2b-4a55-41be-beaa-0393b167adcd None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.828804 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7953e2b-4a55-41be-beaa-0393b167adcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:23.829103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7953e2b-4a55-41be-beaa-0393b167adcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:23.830562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7953e2b-4a55-41be-beaa-0393b167adcd None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:23.842446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 425/875] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:23.848451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:23.898319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635e831-c044-4d0f-bfd7-622f1a2dd5b4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.898499 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635e831-c044-4d0f-bfd7-622f1a2dd5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.898778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635e831-c044-4d0f-bfd7-622f1a2dd5b4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.900400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 426/876] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:23.905587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d76e8-584c-4484-a47f-f4ddb7546c05 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.905875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d76e8-584c-4484-a47f-f4ddb7546c05 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.906152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d76e8-584c-4484-a47f-f4ddb7546c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.926684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-210d76e8-584c-4484-a47f-f4ddb7546c05 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:23.927872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-210d76e8-584c-4484-a47f-f4ddb7546c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:23.953340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636453f-b250-4982-a3c6-b7d7a84d8349 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:23.989578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:23.990636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:23.991154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:23.991631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:23.992659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=6f320795fd0b42319df94dbc171938b8) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:23.993154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:23.994801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:24.005667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 451/877] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:23 2022] GET /identity/v3/role_assignments?user.id=6f320795fd0b42319df94dbc171938b8&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:24.013691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 427/878] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:24.030959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:24.139988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86193451-cff7-43cc-a6cc-3144a3878736 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:24.177774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:24.178581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:24.178856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:24.179173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:24.179850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:24.181296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:24.194593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:24.195570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:24.196842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 452/879] 10.222.0.58 () {56 vars in 1132 bytes} [Mon May 16 17:27:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:24.208303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d76e8-584c-4484-a47f-f4ddb7546c05 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:24.308563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d76e8-584c-4484-a47f-f4ddb7546c05 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:24.342524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:24.343542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:24.344044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:24.344514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:24.345413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:24.345950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:24.347509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:24.357259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 428/880] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:24.358845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:24.462405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a62c-4f37-489e-9775-4268117087f0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:24.496157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3784d79-0b52-4b97-8b5b-7cddc3cd7121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:24.496831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784d79-0b52-4b97-8b5b-7cddc3cd7121 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:24.497094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784d79-0b52-4b97-8b5b-7cddc3cd7121 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:24.497363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784d79-0b52-4b97-8b5b-7cddc3cd7121 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:24.498095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3784d79-0b52-4b97-8b5b-7cddc3cd7121 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:24.498398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3784d79-0b52-4b97-8b5b-7cddc3cd7121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:24.499767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3784d79-0b52-4b97-8b5b-7cddc3cd7121 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:24.504970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 453/881] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:24.510844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:24.614159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8c0b3-2fb1-4aed-895e-033e86f92e66 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:24.614492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8c0b3-2fb1-4aed-895e-033e86f92e66 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:24.614711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8c0b3-2fb1-4aed-895e-033e86f92e66 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:24.616322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 454/882] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:24.616982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331fdd-b5ca-4dec-adc5-0c24149352d2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:24.621660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b615d73-ad83-465d-bafc-c976b7acc78f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:24.622192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b615d73-ad83-465d-bafc-c976b7acc78f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:24.622684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b615d73-ad83-465d-bafc-c976b7acc78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:24.639302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7b615d73-ad83-465d-bafc-c976b7acc78f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:24.640808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7b615d73-ad83-465d-bafc-c976b7acc78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:24.656153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:24.657041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:24.657320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:24.657631 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:24.658396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] RBAC: Adding query filter params (interface=public, service_id=a5220054efb041dabba9f57a738e6d70, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:24.658706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:24.660506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:24.669579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 429/883] 10.222.0.58 () {56 vars in 1251 bytes} [Mon May 16 17:27:24 2022] GET /identity/v3/endpoints?service_id=a5220054efb041dabba9f57a738e6d70&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:24.674028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:24.721718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 455/884] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:24.738589 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b615d73-ad83-465d-bafc-c976b7acc78f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:24.788845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db545219-638b-479e-ae24-4d92e37be26f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:24.830224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f87fd-2659-4873-bd46-03b33525f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:24.830901 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f87fd-2659-4873-bd46-03b33525f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:24.831168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f87fd-2659-4873-bd46-03b33525f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:24.831443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f87fd-2659-4873-bd46-03b33525f4b9 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:24.832137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f87fd-2659-4873-bd46-03b33525f4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:24.834167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f87fd-2659-4873-bd46-03b33525f4b9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:24.845627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 430/885] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:27:24 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:27:24.851999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b615d73-ad83-465d-bafc-c976b7acc78f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:24.892635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:24.893850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:24.894347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:24.894982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:24.895833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:24.897432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:24.911091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:24.912210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:24.913071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:24.916276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 456/886] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:24.922852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f87fd-2659-4873-bd46-03b33525f4b9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:25.031451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f87fd-2659-4873-bd46-03b33525f4b9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:25.066907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:25.067978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:25.068486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:25.068934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:25.069907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:25.070381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:25.071950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:25.077459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 431/887] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:25.083727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:25.182181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4710ec5-34ea-4865-a75e-c9dcdb712bcf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:25.216908 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:25.218025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:25.218556 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:25.219037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:25.219983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:25.220509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:25.222165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:25.233040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 457/888] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:25.234772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:25.335223 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f37f7-d3cf-4739-815c-d277be663d12 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:25.369278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977f204-01d9-4076-b787-df1ef396bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:25.370337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977f204-01d9-4076-b787-df1ef396bc20 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:25.370884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977f204-01d9-4076-b787-df1ef396bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:25.371428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977f204-01d9-4076-b787-df1ef396bc20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:25.372479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977f204-01d9-4076-b787-df1ef396bc20 None admin] RBAC: Adding query filter params (interface=public, service_id=c063b3a87ea14dfc8c5a45e4aa1b7e06, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:25.373041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977f204-01d9-4076-b787-df1ef396bc20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:25.374689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977f204-01d9-4076-b787-df1ef396bc20 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:25.384626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 432/889] 10.222.0.58 () {56 vars in 1251 bytes} [Mon May 16 17:27:25 2022] GET /identity/v3/endpoints?service_id=c063b3a87ea14dfc8c5a45e4aa1b7e06&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:25.386244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:25.487929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7bea1-0c57-4bf5-ba7c-9edd1b61126b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:25.522465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc8c7-c5f1-4878-ba19-7fccb6e12874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:25.523134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc8c7-c5f1-4878-ba19-7fccb6e12874 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:25.523413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc8c7-c5f1-4878-ba19-7fccb6e12874 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:25.523686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc8c7-c5f1-4878-ba19-7fccb6e12874 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:25.524367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc8c7-c5f1-4878-ba19-7fccb6e12874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:25.525761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc8c7-c5f1-4878-ba19-7fccb6e12874 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:25.531845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 458/890] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:27:25 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:27:25.639456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705fb0-e3d1-41b2-86c7-d5582edf3664 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:25.639683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705fb0-e3d1-41b2-86c7-d5582edf3664 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:25.639998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705fb0-e3d1-41b2-86c7-d5582edf3664 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:25.641513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 433/891] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:25.647189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39cde-f036-4db1-913f-6f1ea0238478 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:25.647474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39cde-f036-4db1-913f-6f1ea0238478 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:25.647749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39cde-f036-4db1-913f-6f1ea0238478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:25.665702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e2a39cde-f036-4db1-913f-6f1ea0238478 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:25.666958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e2a39cde-f036-4db1-913f-6f1ea0238478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:25.739084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 459/892] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:25.764813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705fb0-e3d1-41b2-86c7-d5582edf3664 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:25.870379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705fb0-e3d1-41b2-86c7-d5582edf3664 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:25.906522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79464110-dda7-4f68-9aa5-f9ee63154144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:25.907794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464110-dda7-4f68-9aa5-f9ee63154144 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:25.908246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464110-dda7-4f68-9aa5-f9ee63154144 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:25.908687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464110-dda7-4f68-9aa5-f9ee63154144 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:25.919284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79464110-dda7-4f68-9aa5-f9ee63154144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-79464110-dda7-4f68-9aa5-f9ee63154144 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:25.927992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:25.928918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:25.929819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:25.932170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 434/893] 10.222.0.58 () {56 vars in 1120 bytes} [Mon May 16 17:27:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:25.938227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39cde-f036-4db1-913f-6f1ea0238478 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.034458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39cde-f036-4db1-913f-6f1ea0238478 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.069661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.070626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.071047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.071469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.072373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:26.072830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:26.074411 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:26.083452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 460/894] 10.222.0.58 () {56 vars in 1115 bytes} [Mon May 16 17:27:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:26.089126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79464110-dda7-4f68-9aa5-f9ee63154144 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.201446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79464110-dda7-4f68-9aa5-f9ee63154144 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.235433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec2bbf-2e69-409f-b21a-200a3d1f36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.236238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec2bbf-2e69-409f-b21a-200a3d1f36f6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.236571 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec2bbf-2e69-409f-b21a-200a3d1f36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.236849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec2bbf-2e69-409f-b21a-200a3d1f36f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.247531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec2bbf-2e69-409f-b21a-200a3d1f36f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:26.248987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec2bbf-2e69-409f-b21a-200a3d1f36f6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-27ec2bbf-2e69-409f-b21a-200a3d1f36f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:26.265781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:26.266663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:26.267555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:26.267555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:26.267555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:26.267555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:26.267555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 435/895] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:26.273887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.320672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b1d7-32a7-4b08-9206-96a68ba2c822 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.321007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b1d7-32a7-4b08-9206-96a68ba2c822 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.321226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b1d7-32a7-4b08-9206-96a68ba2c822 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.322684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 436/896] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:26.328181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3bed1-e065-4bc7-9a40-fa910d8ca5cc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.328533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3bed1-e065-4bc7-9a40-fa910d8ca5cc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.328872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3bed1-e065-4bc7-9a40-fa910d8ca5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.345989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-87c3bed1-e065-4bc7-9a40-fa910d8ca5cc None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:26.347214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-87c3bed1-e065-4bc7-9a40-fa910d8ca5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:26.384014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d7e6b-3bac-4b94-b969-043d6eef465d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.414050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 437/897] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:26.416952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.417711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.417994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.418266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.418986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:26.419309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:26.420649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:26.433221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 461/898] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:26.438677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.438798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3bed1-e065-4bc7-9a40-fa910d8ca5cc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.554485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3bed1-e065-4bc7-9a40-fa910d8ca5cc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.555673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2493-379b-420c-90c1-2500fc501960 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.593457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.594398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.594780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.595065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.595373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.595861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:26.596237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.596518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.596792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.597454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:26.605173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:26.606829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:26.612275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:26.613297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:26.614166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:26.618878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 438/899] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:26.619823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:26.624291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:26.626330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:26.628252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 462/900] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:27:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:26.634642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.738568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1ff5-15d6-48db-9141-ac69add7f649 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.745217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0487a9-f1c3-4e91-8963-3cc42104cff4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.772247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.773088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.773406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.773778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.774579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:26.774945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:26.776745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:26.785919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 439/901] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:26.788215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.789733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.790611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.791245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.791718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.793730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:26.794255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:26.795872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:26.821495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 463/902] 10.222.0.58 () {56 vars in 1149 bytes} [Mon May 16 17:27:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:26.827267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:26.901540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d8c03-cbb3-4ccc-9018-8a549fdb5491 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.934749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd7bcf-8cf8-44e2-8358-08119844caed None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:26.942879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.943661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.944091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.944458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:26.945254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:26.945689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:26.947138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:26.957790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 440/903] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:26.973801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4205a1-d4ce-42f7-9036-2d6c1650efa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:26.974811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4205a1-d4ce-42f7-9036-2d6c1650efa1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:26.975261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4205a1-d4ce-42f7-9036-2d6c1650efa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:26.975675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4205a1-d4ce-42f7-9036-2d6c1650efa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.052899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4205a1-d4ce-42f7-9036-2d6c1650efa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:27.054836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4205a1-d4ce-42f7-9036-2d6c1650efa1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:27.159624 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 464/904] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:26 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 17:27:27.165257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.179370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8335-b6ef-4c01-b075-1aff588e2a6a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.179664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8335-b6ef-4c01-b075-1aff588e2a6a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.179927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8335-b6ef-4c01-b075-1aff588e2a6a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.181601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 465/905] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:27.186883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c671-b7bb-4bc9-9922-5f35112bdb75 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.187166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c671-b7bb-4bc9-9922-5f35112bdb75 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.187445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c671-b7bb-4bc9-9922-5f35112bdb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.204590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-81c1c671-b7bb-4bc9-9922-5f35112bdb75 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:27.205813 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-81c1c671-b7bb-4bc9-9922-5f35112bdb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:27.277899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8ee97-d929-47b2-9cae-87f21356f69f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.279515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 466/906] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:27.305909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1c671-b7bb-4bc9-9922-5f35112bdb75 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.320827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:27.321663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.322258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.322258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.333316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:27.334803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:27.352616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:27.353617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:27.354504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:27.354504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:27.354504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:27.354504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:27.354504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 441/907] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:27.360051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.423011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1c671-b7bb-4bc9-9922-5f35112bdb75 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.461029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de9ee7-b328-43dc-952e-851fd7177ff8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.467679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:27.468508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.468790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.469062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.470178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:27.471979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:27.487870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:27.489040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:27.489976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 467/908] 10.222.0.58 () {56 vars in 1132 bytes} [Mon May 16 17:27:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:27.495160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.499421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:27.500369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.500843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.501326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.502271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:27.502766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:27.504314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:27.521797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 442/909] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:27.524534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.617407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39635e-198d-4069-a1b7-d1abf02da751 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.626168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421e0a9-96d2-4fb9-8704-f2f1c5d65c89 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.657801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:27.658479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.658762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.659039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.659746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:27.660053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:27.661431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:27.667920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:27.668729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.669010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.669284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.672124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 468/910] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:27.678516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.680986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:27.682721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:27.698172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:27.699400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:27.700401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:27.700401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:27.700401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:27.700401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:27.700401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:27.700401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:27.700401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:27.700401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:27.703163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 443/911] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:27.709501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.807660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75268-1bed-4c86-9215-a2a7feb98111 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.818225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f520a37-61de-4a0d-9ee3-18d256083a0c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.847940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:27.849059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.849515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.850019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.851078 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:27.851533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:27.851956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:27.852739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:27.853115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:27.853486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:27.853762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:27.854478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:27.854884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:27.856596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:27.859906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 469/912] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:27.867755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.869633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 444/913] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:27.875189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:27.963624 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86b5b-7465-4af8-9c40-3ef1216ace5f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.976618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfb273-620b-43d3-8af7-0a9e6c8bb1d3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:27.998332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9227b4-95b9-4748-90c2-5653741b859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:27.999525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9227b4-95b9-4748-90c2-5653741b859f None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:28.000191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9227b4-95b9-4748-90c2-5653741b859f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:28.000628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9227b4-95b9-4748-90c2-5653741b859f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:28.002003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9227b4-95b9-4748-90c2-5653741b859f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:28.003936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9227b4-95b9-4748-90c2-5653741b859f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:28.008804 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785a0bf-ae4d-42b9-9652-77b897bc29fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:28.009457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a0bf-ae4d-42b9-9652-77b897bc29fa None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:28.009765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a0bf-ae4d-42b9-9652-77b897bc29fa None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:28.010034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a0bf-ae4d-42b9-9652-77b897bc29fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:28.010854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785a0bf-ae4d-42b9-9652-77b897bc29fa None admin] RBAC: Adding query filter params (role.id=a925cb2cd7f64798b237f417c313fb5c, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=8a71982b29f447899a3d06885cf237bd) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:28.011160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785a0bf-ae4d-42b9-9652-77b897bc29fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:28.012657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785a0bf-ae4d-42b9-9652-77b897bc29fa None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:28.018680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 445/914] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:27 2022] GET /identity/v3/role_assignments?user.id=8a71982b29f447899a3d06885cf237bd&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=a925cb2cd7f64798b237f417c313fb5c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:28.020432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aec95-fc88-4fc5-9619-68ee5d2a9c17 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:28.020794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aec95-fc88-4fc5-9619-68ee5d2a9c17 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:28.021122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aec95-fc88-4fc5-9619-68ee5d2a9c17 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:28.025622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 446/915] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:28.029486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac562-a865-4215-b98e-ce0a9f1642f8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:28.030218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac562-a865-4215-b98e-ce0a9f1642f8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:28.031020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac562-a865-4215-b98e-ce0a9f1642f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:28.036305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 470/916] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:27:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:28.049321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2f4ac562-a865-4215-b98e-ce0a9f1642f8 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:28.051248 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2f4ac562-a865-4215-b98e-ce0a9f1642f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:28.134241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 447/917] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:28.157831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9227b4-95b9-4748-90c2-5653741b859f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:28.284672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9227b4-95b9-4748-90c2-5653741b859f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:28.318886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:28.319707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:28.319983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:28.320280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:28.320932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:28.322401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:28.334095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:28.335394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:28.336465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 471/918] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:28.342914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac562-a865-4215-b98e-ce0a9f1642f8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:28.444031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac562-a865-4215-b98e-ce0a9f1642f8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:28.477634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:28.478307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:28.478584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:28.478857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:28.479566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:28.479866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:28.481272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:28.486406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 448/919] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:28.491937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:28.593218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7b70-2cee-437e-bba9-d4b87ea098ab None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:28.627395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6ebf8-7840-421d-9f1f-e3f45e740748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:28.628439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6ebf8-7840-421d-9f1f-e3f45e740748 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:28.628946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6ebf8-7840-421d-9f1f-e3f45e740748 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:28.629430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6ebf8-7840-421d-9f1f-e3f45e740748 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:28.630365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6ebf8-7840-421d-9f1f-e3f45e740748 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:28.630866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6ebf8-7840-421d-9f1f-e3f45e740748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:28.632445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6ebf8-7840-421d-9f1f-e3f45e740748 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:28.638082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 472/920] 10.222.0.58 () {56 vars in 1114 bytes} [Mon May 16 17:27:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:28.643913 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:28.745580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817333-f627-4b38-a6ba-27b6eb90c24a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:28.778878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c89a-2484-443b-9d15-4842355d1a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:28.779580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c89a-2484-443b-9d15-4842355d1a52 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:28.779861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c89a-2484-443b-9d15-4842355d1a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:28.780132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c89a-2484-443b-9d15-4842355d1a52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:28.780880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c89a-2484-443b-9d15-4842355d1a52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:28.782279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c89a-2484-443b-9d15-4842355d1a52 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:28.801349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 449/921] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:27:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:27:29.244010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdf8d9-dcbc-4267-95fd-682c7b3962e8 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:29.244343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdf8d9-dcbc-4267-95fd-682c7b3962e8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:29.244558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdf8d9-dcbc-4267-95fd-682c7b3962e8 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:29.246389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 473/922] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:29.252477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafaba-f87b-485c-b2c7-3de8b737c40f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:29.253062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafaba-f87b-485c-b2c7-3de8b737c40f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:29.253062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafaba-f87b-485c-b2c7-3de8b737c40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:29.271244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bcaafaba-f87b-485c-b2c7-3de8b737c40f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:29.272794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bcaafaba-f87b-485c-b2c7-3de8b737c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:29.344427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 450/923] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:29.366697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdf8d9-dcbc-4267-95fd-682c7b3962e8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:29.471001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdf8d9-dcbc-4267-95fd-682c7b3962e8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:29.503453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0b57-886a-44ba-b5f2-274bb68f8440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:29.504119 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0b57-886a-44ba-b5f2-274bb68f8440 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:29.504407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0b57-886a-44ba-b5f2-274bb68f8440 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:29.504685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0b57-886a-44ba-b5f2-274bb68f8440 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:29.505404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0b57-886a-44ba-b5f2-274bb68f8440 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:29.506817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0b57-886a-44ba-b5f2-274bb68f8440 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:29.522825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 474/924] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:27:29 2022] POST /identity/v3/services => generated 241 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:27:30.365719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9706b-0d11-4af0-8fd3-7294da4312f8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.366265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9706b-0d11-4af0-8fd3-7294da4312f8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.366265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9706b-0d11-4af0-8fd3-7294da4312f8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.367916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 451/925] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:30.373730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2d89-5070-47b7-a7d2-46d8bb070b36 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.374156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2d89-5070-47b7-a7d2-46d8bb070b36 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.374336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2d89-5070-47b7-a7d2-46d8bb070b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.390950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c5bd2d89-5070-47b7-a7d2-46d8bb070b36 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:30.392118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c5bd2d89-5070-47b7-a7d2-46d8bb070b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:30.406691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f602b2-2e0c-42ee-8ed3-df0bd7b20db1 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.406984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f602b2-2e0c-42ee-8ed3-df0bd7b20db1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.407260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f602b2-2e0c-42ee-8ed3-df0bd7b20db1 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.408907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 452/926] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:30.418484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2572ce-d336-451b-b59d-b0114348f2bf None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.418876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2572ce-d336-451b-b59d-b0114348f2bf None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.419256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2572ce-d336-451b-b59d-b0114348f2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.436503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ae2572ce-d336-451b-b59d-b0114348f2bf None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:30.437828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ae2572ce-d336-451b-b59d-b0114348f2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:30.467434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 475/927] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:30.492786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd2d89-5070-47b7-a7d2-46d8bb070b36 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:30.525213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 453/928] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:30.547939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2572ce-d336-451b-b59d-b0114348f2bf None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:30.603636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd2d89-5070-47b7-a7d2-46d8bb070b36 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:30.639045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:30.640271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.640781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.641258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.642173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:30.643803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:30.647755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2572ce-d336-451b-b59d-b0114348f2bf None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:30.656753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:30.657802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:30.658652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:30.666190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 476/929] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:30.667823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:30.682495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf04eb3-6094-48ab-9ce3-27986eadb6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:30.683390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf04eb3-6094-48ab-9ce3-27986eadb6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.683668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf04eb3-6094-48ab-9ce3-27986eadb6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.683943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf04eb3-6094-48ab-9ce3-27986eadb6c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.694387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf04eb3-6094-48ab-9ce3-27986eadb6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-5bf04eb3-6094-48ab-9ce3-27986eadb6c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:30.702591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:30.703547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:30.704775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:30.709370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 454/930] 10.222.0.58 () {56 vars in 1120 bytes} [Mon May 16 17:27:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:30.710477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf04eb3-6094-48ab-9ce3-27986eadb6c8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:30.778644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab78d7d-aef0-43a9-ba8f-f182865e89fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:30.810542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf04eb3-6094-48ab-9ce3-27986eadb6c8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:30.820524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:30.821490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.821991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.822472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.823464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:30.824047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:30.825657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:30.836437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 477/931] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:30.838612 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:30.851228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:30.851961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.852249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.852511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.853408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:30.853635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:30.855075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:30.868378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 455/932] 10.222.0.58 () {56 vars in 1115 bytes} [Mon May 16 17:27:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:30.869243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:30.946060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5103ada-9716-4257-9ab3-4cba13f179f1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:30.970446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5af62-dd60-4c2e-9fe0-02616b6c994c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:30.980169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:30.981145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:30.981695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:30.982219 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:30.983176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:30.983688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:30.985260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:30.997732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 478/933] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:31.003869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e962e-1abf-4697-af01-9afbda7bef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:31.004693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e962e-1abf-4697-af01-9afbda7bef51 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.004970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e962e-1abf-4697-af01-9afbda7bef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.005239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e962e-1abf-4697-af01-9afbda7bef51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.017764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e962e-1abf-4697-af01-9afbda7bef51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:31.019261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e962e-1abf-4697-af01-9afbda7bef51 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-125e962e-1abf-4697-af01-9afbda7bef51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:31.038491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:31.039447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:31.040802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:31.040802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:31.040802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:31.040802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.040802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 456/934] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:31.045870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.079665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd45c30-f952-492c-8fa3-ad8e28f727a5 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.080111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd45c30-f952-492c-8fa3-ad8e28f727a5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.080388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd45c30-f952-492c-8fa3-ad8e28f727a5 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.082834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 457/935] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:31.088321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb941ad-ad74-4e7b-a2b2-15b7bcd8e8a2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.088595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb941ad-ad74-4e7b-a2b2-15b7bcd8e8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.088876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb941ad-ad74-4e7b-a2b2-15b7bcd8e8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.106427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0cb941ad-ad74-4e7b-a2b2-15b7bcd8e8a2 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:31.107621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0cb941ad-ad74-4e7b-a2b2-15b7bcd8e8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:31.182701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca240aa-6317-4500-840e-f7e5092ada8b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:31.192647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 458/936] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:31.211297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb941ad-ad74-4e7b-a2b2-15b7bcd8e8a2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.225058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:31.226143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.226428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.226716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.227489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:31.227796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:31.230359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:31.249411 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 479/937] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:31.251840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.326919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb941ad-ad74-4e7b-a2b2-15b7bcd8e8a2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:31.362962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:31.363632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.363907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.364173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.364869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:31.366330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:31.367695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING keystone.server.flask.common [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 17:27:31.379401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2449a-05bd-4cc0-901a-15eda2fece0e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:31.386102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.sql.core [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 17:27:31.386102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 17:27:31.386102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [parameters: {'id': '62436279552343c098d865dc9bff9635', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 17:27:31.386102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80038) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 62436279552343c098d865dc9bff9635.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 62436279552343c098d865dc9bff9635. May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = self._query(query) May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application conn.query(q) May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 17:27:31.394126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result.read() May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 17:27:31.394939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application next(self.gen) May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application yield resource May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application next(self.gen) May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.session.rollback() May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.force_reraise() May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise self.value May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application session.commit() May 16 17:27:31.395896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._prepare_impl() May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.session.flush() May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._flush(objects) May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application compat.raise_( May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application flush_context.execute() May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 17:27:31.396791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rec.execute(self) May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 17:27:31.398551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = self._query(query) May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application conn.query(q) May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result.read() May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 17:27:31.400405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [parameters: {'id': '62436279552343c098d865dc9bff9635', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:31.409922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:31.411853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 62436279552343c098d865dc9bff9635. May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 459/938] 10.222.0.58 () {60 vars in 1140 bytes} [Mon May 16 17:27:31 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:31.413998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.415399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:31.415567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.415717 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.421577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.423211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:31.424666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:31.443649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:31.445913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:31.448198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:31.457594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 480/939] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:27:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:31.457594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.506363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9a0c6-4532-498a-890f-5f195d081ef9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:31.541040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:31.541969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.542242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.542637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.551007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:31.552956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:31.559793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3886ff-2caa-4a08-8bf3-d847d0d4c27a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:31.570528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:31.572535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:31.574766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:31.574766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:31.574766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:31.574766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:31.574766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:31.574766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:31.574766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:31.574766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:31.578845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 460/940] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:31.580089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.596919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:31.597886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.598317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.598744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.599723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:31.600275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:31.601883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:31.623970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 481/941] 10.222.0.58 () {56 vars in 1149 bytes} [Mon May 16 17:27:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:31.625537 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.680661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f68d3-63c7-41a8-95ca-359598fdf079 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:31.714265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0c3c3-6181-46b7-9366-7a03708a737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:31.714935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0c3c3-6181-46b7-9366-7a03708a737a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.715214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0c3c3-6181-46b7-9366-7a03708a737a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.715721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0c3c3-6181-46b7-9366-7a03708a737a None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.716233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0c3c3-6181-46b7-9366-7a03708a737a None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:31.716532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0c3c3-6181-46b7-9366-7a03708a737a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:31.717985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0c3c3-6181-46b7-9366-7a03708a737a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:31.724604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841f500-bd5e-44d5-bb6a-70ff7f8e1630 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:31.739044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 461/942] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:31.747564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0e50-11c1-4ebb-bff8-88a8bfd6f46f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.747954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0e50-11c1-4ebb-bff8-88a8bfd6f46f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.748294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0e50-11c1-4ebb-bff8-88a8bfd6f46f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.750185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 462/943] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:31.756749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37fb7c-a136-4147-8732-8cadfa922570 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.756749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37fb7c-a136-4147-8732-8cadfa922570 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.757174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37fb7c-a136-4147-8732-8cadfa922570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.765875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:31.767019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:31.767492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:31.767963 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:31.775735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3b37fb7c-a136-4147-8732-8cadfa922570 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:31.777515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3b37fb7c-a136-4147-8732-8cadfa922570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:31.782570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:31.784335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:31.810632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:31.811807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:31.812935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:31.812935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:31.812935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:31.812935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:31.814875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 482/944] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:31.820808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.869224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 463/945] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:31.886431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37fb7c-a136-4147-8732-8cadfa922570 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:31.956824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc9fa8-c8e8-48de-addc-6b079c336a30 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.006465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.006465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.006741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37fb7c-a136-4147-8732-8cadfa922570 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.006848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.006930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.007608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:32.008004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.009288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.025591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 483/946] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:32.028359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:32.055822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.057056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.057592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.058153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.059010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.060705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:32.073044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:32.074136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:32.075002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:32.081892 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 464/947] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:32.084076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:32.143497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418f84a-f98d-41f5-8a47-3a0f53c9a9e1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.184712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d30db-5d7d-48fb-bd5d-95f0130340c1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.184939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.185738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.186016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.186287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.194521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.196323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:32.214590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:32.215582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:32.216485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 484/948] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:32.221872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:32.233666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.234995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.235793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.236438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.237437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:32.237960 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.240338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.251206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 465/949] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:32.251976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:32.344620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95db24-8bda-487e-b2b6-cd92a692a83f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.373716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150c09c-51e1-4628-a795-83c067f00b7e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.379079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.379747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.380237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.380313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.381049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:32.381352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.382834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.394829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 485/950] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:32.402524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:32.417496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.418275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.418794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.419076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.419871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:32.420174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.422172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.429632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 466/951] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:32.434138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:32.530192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b15946-81d2-4f4c-8522-641feaa654bc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.552736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecd164-4a22-47be-bc8f-cf95029afa79 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.569945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c680c6-571b-4bdc-8936-c9c8e90b027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.570868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c680c6-571b-4bdc-8936-c9c8e90b027e None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.571277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c680c6-571b-4bdc-8936-c9c8e90b027e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.571563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c680c6-571b-4bdc-8936-c9c8e90b027e None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/8a71982b29f447899a3d06885cf237bd/roles/a925cb2cd7f64798b237f417c313fb5c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.574398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c680c6-571b-4bdc-8936-c9c8e90b027e None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=8a71982b29f447899a3d06885cf237bd, role_id=a925cb2cd7f64798b237f417c313fb5c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.575851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c680c6-571b-4bdc-8936-c9c8e90b027e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.594733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 486/952] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:27:32 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/8a71982b29f447899a3d06885cf237bd/roles/a925cb2cd7f64798b237f417c313fb5c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:27:32.604914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd433-e31a-4008-bf00-1066678bab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.606043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd433-e31a-4008-bf00-1066678bab62 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.606517 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd433-e31a-4008-bf00-1066678bab62 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.606994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd433-e31a-4008-bf00-1066678bab62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.608146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd433-e31a-4008-bf00-1066678bab62 None admin] RBAC: Adding query filter params (interface=public, service_id=900f701c85674acaa3535ebb12b52088, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:32.608663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd433-e31a-4008-bf00-1066678bab62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.610351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd433-e31a-4008-bf00-1066678bab62 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.616984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 467/953] 10.222.0.58 () {56 vars in 1251 bytes} [Mon May 16 17:27:32 2022] GET /identity/v3/endpoints?service_id=900f701c85674acaa3535ebb12b52088&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:32.623131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c680c6-571b-4bdc-8936-c9c8e90b027e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:32.733911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c680c6-571b-4bdc-8936-c9c8e90b027e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:32.777360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef505a8-8307-4c0b-a536-b9704a7065ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:32.778108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef505a8-8307-4c0b-a536-b9704a7065ff None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:32.778390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef505a8-8307-4c0b-a536-b9704a7065ff None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:32.778666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef505a8-8307-4c0b-a536-b9704a7065ff None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:32.779362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef505a8-8307-4c0b-a536-b9704a7065ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:32.780898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef505a8-8307-4c0b-a536-b9704a7065ff None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:32.788115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 487/954] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:27:32 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:27:33.351536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195af32-6376-42af-a49e-a6cd3fd92ba6 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:33.351937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195af32-6376-42af-a49e-a6cd3fd92ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:33.352116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195af32-6376-42af-a49e-a6cd3fd92ba6 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:33.353634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 468/955] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:33.359121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba07bb-a97a-4590-a1f7-b4743e6c335c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:33.359417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba07bb-a97a-4590-a1f7-b4743e6c335c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:33.359696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba07bb-a97a-4590-a1f7-b4743e6c335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:33.377041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9cba07bb-a97a-4590-a1f7-b4743e6c335c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:33.378252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9cba07bb-a97a-4590-a1f7-b4743e6c335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:33.450679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 488/956] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:33.473371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195af32-6376-42af-a49e-a6cd3fd92ba6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:33.582322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195af32-6376-42af-a49e-a6cd3fd92ba6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:33.616371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c44d6-bea9-4743-b228-18ee94c7c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:33.617051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c44d6-bea9-4743-b228-18ee94c7c0f8 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:33.617336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c44d6-bea9-4743-b228-18ee94c7c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:33.617631 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c44d6-bea9-4743-b228-18ee94c7c0f8 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:33.618374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c44d6-bea9-4743-b228-18ee94c7c0f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:33.619752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c44d6-bea9-4743-b228-18ee94c7c0f8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:33.640323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 469/957] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:27:33 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:34.099509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e401d8-67bb-4a13-b520-bcf98cb1be48 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:34.099869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e401d8-67bb-4a13-b520-bcf98cb1be48 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:34.100070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e401d8-67bb-4a13-b520-bcf98cb1be48 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:34.101748 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 489/958] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:34.107151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c5f9-768f-49f2-b88b-7e0a770ae01a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:34.107438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c5f9-768f-49f2-b88b-7e0a770ae01a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:34.107713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c5f9-768f-49f2-b88b-7e0a770ae01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:34.124406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-08f4c5f9-768f-49f2-b88b-7e0a770ae01a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:34.125681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-08f4c5f9-768f-49f2-b88b-7e0a770ae01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:34.203738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 470/959] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:34.227954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e401d8-67bb-4a13-b520-bcf98cb1be48 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:34.327804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e401d8-67bb-4a13-b520-bcf98cb1be48 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:34.361077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:34.361766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:34.362068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:34.362360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:34.363100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:34.364613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:34.366010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING keystone.server.flask.common [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 17:27:34.378855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.sql.core [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 17:27:34.378855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 17:27:34.378855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [parameters: {'user_id': 'e17aa70495494d39b647db7d622f220c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 17:27:34.378855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80037) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result = self._query(query) May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application conn.query(q) May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result.read() May 16 17:27:34.396629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 17:27:34.397695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application next(self.gen) May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application yield resource May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application next(self.gen) May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.session.rollback() May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.force_reraise() May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise self.value May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application session.commit() May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 17:27:34.398647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._prepare_impl() May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.session.flush() May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._flush(objects) May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application compat.raise_( May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application flush_context.execute() May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rec.execute(self) May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 17:27:34.399539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 17:27:34.400427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result = self._query(query) May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application conn.query(q) May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result.read() May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 17:27:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e17aa70495494d39b647db7d622f220c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:34.403978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 17:27:34.405919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 17:27:34.408054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 17:27:34.408054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 17:27:34.408054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 17:27:34.408054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 17:27:34.408054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 17:27:34.408054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:34.408054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 490/960] 10.222.0.58 () {60 vars in 1131 bytes} [Mon May 16 17:27:34 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:34.414203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4c5f9-768f-49f2-b88b-7e0a770ae01a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:34.506831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4c5f9-768f-49f2-b88b-7e0a770ae01a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:34.541888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c74157-867a-43a2-ad27-df2011ef22e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:34.542828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c74157-867a-43a2-ad27-df2011ef22e2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:34.543115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c74157-867a-43a2-ad27-df2011ef22e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:34.543392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c74157-867a-43a2-ad27-df2011ef22e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:34.551282 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c74157-867a-43a2-ad27-df2011ef22e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:34.552728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c74157-867a-43a2-ad27-df2011ef22e2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-74c74157-867a-43a2-ad27-df2011ef22e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:34.568837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:34.571099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:34.573328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 471/961] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:34.577570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:34.688527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c1f29-6e6c-4693-af62-6c80ba855e6b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:34.724944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f562a-3cce-4c3b-b3f3-c2f3b1c32e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:34.725664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f562a-3cce-4c3b-b3f3-c2f3b1c32e88 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:34.725939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f562a-3cce-4c3b-b3f3-c2f3b1c32e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:34.726203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f562a-3cce-4c3b-b3f3-c2f3b1c32e88 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:34.727016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f562a-3cce-4c3b-b3f3-c2f3b1c32e88 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:34.727313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f562a-3cce-4c3b-b3f3-c2f3b1c32e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:34.728970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f562a-3cce-4c3b-b3f3-c2f3b1c32e88 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:34.767642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 491/962] 10.222.0.58 () {56 vars in 1101 bytes} [Mon May 16 17:27:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:34.893933 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2984-b42c-4d0e-bd61-203953cad68d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:34.894376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2984-b42c-4d0e-bd61-203953cad68d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:34.894761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2984-b42c-4d0e-bd61-203953cad68d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:34.896599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 472/963] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:34.902965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e2d7-6f02-4848-902c-b34cedaee36f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:34.903393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e2d7-6f02-4848-902c-b34cedaee36f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:34.903759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e2d7-6f02-4848-902c-b34cedaee36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:34.921816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0301e2d7-6f02-4848-902c-b34cedaee36f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:34.923350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0301e2d7-6f02-4848-902c-b34cedaee36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:35.001731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 492/964] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:35.020296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade2984-b42c-4d0e-bd61-203953cad68d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.120668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade2984-b42c-4d0e-bd61-203953cad68d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.138558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a49f6-1a31-46b1-a971-8fa6715700a6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.138923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a49f6-1a31-46b1-a971-8fa6715700a6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.139264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a49f6-1a31-46b1-a971-8fa6715700a6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.140732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 493/965] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:35.146660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeab0e-3c81-4bbe-99b1-4cd0020546e1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.147456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeab0e-3c81-4bbe-99b1-4cd0020546e1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.147734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeab0e-3c81-4bbe-99b1-4cd0020546e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.157910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582189d-0d95-48a9-a71b-db76a4bc765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.158729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582189d-0d95-48a9-a71b-db76a4bc765d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.159007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582189d-0d95-48a9-a71b-db76a4bc765d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.159275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582189d-0d95-48a9-a71b-db76a4bc765d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.163879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5beeab0e-3c81-4bbe-99b1-4cd0020546e1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:35.165035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5beeab0e-3c81-4bbe-99b1-4cd0020546e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:35.169246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582189d-0d95-48a9-a71b-db76a4bc765d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-4582189d-0d95-48a9-a71b-db76a4bc765d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:35.177782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:35.178691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:35.179665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 473/966] 10.222.0.58 () {56 vars in 1120 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:35.184800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582189d-0d95-48a9-a71b-db76a4bc765d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.235625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 494/967] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:35.258467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beeab0e-3c81-4bbe-99b1-4cd0020546e1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.294357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582189d-0d95-48a9-a71b-db76a4bc765d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.326621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.327299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.327568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.327847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.328585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:35.328885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.330272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.342692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 474/968] 10.222.0.58 () {56 vars in 1115 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:35.343661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.355251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beeab0e-3c81-4bbe-99b1-4cd0020546e1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.389046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.389331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.389633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.390284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.391651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:35.403387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:35.404387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:35.405224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 495/969] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:35.410524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.446588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221140c5-3f28-4512-91e0-8338dd82e1a4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.479488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.480364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.480644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.480916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.491257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.492714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:35.509450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:35.511190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:35.512287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:35.512287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:35.512287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:35.512287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:35.514895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6b80-4e22-44d1-873b-3835d1b14496 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.515851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 475/970] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:35.516586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.548496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.549160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.549434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.549732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.550442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:35.551094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.552615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.562768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 496/971] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:35.563492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.613470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64799326-5fa6-4806-9b9b-77e5c57e8387 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.647672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.648348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.648632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.648880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.649607 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:35.649919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.651287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.661160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ad8d-b171-4073-8b43-15a2a7585aba None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.662871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 476/972] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:35.668433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.696107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.696986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.697442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.697760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.698492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:35.698789 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.700144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.705639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 497/973] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:35.711127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.763554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19e735-3f45-4405-9e63-b1138bf69484 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.798862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.799687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.799964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.800233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.808359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.809815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.810608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768649-8dec-4f67-a9fe-40b017c25fa3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:35.824833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:35.825974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 17:27:35.827236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:35.830643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 477/974] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:35.831510 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:35.846939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47c236-7a21-41eb-bf04-4dba0887b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.847642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c236-7a21-41eb-bf04-4dba0887b76f None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.847923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c236-7a21-41eb-bf04-4dba0887b76f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.848137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c236-7a21-41eb-bf04-4dba0887b76f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.848862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47c236-7a21-41eb-bf04-4dba0887b76f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.850259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47c236-7a21-41eb-bf04-4dba0887b76f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.869393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 498/975] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:27:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:27:35.933717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719b649-7b75-4236-b4c2-fb442363b322 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:35.961507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3661-376c-44ca-8335-233259cbfc99 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.961835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3661-376c-44ca-8335-233259cbfc99 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.962202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3661-376c-44ca-8335-233259cbfc99 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.963793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 499/976] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:35.969471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93cac4-8ec8-44d0-bcef-7f225507176e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.969888 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93cac4-8ec8-44d0-bcef-7f225507176e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.970252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93cac4-8ec8-44d0-bcef-7f225507176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.982435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:35.983426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:35.983846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:35.984251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:35.985241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:35.985735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:35.987399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:35.988242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2b93cac4-8ec8-44d0-bcef-7f225507176e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:35.989446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2b93cac4-8ec8-44d0-bcef-7f225507176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:36.007154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 478/977] 10.222.0.58 () {56 vars in 1149 bytes} [Mon May 16 17:27:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:36.013373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.068580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 500/978] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:36.091805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93cac4-8ec8-44d0-bcef-7f225507176e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.120629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6ded-7a99-4e0f-927c-54d251281d06 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.158137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d75a8-bfee-48c6-a9f7-a0af7fe70018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.158789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d75a8-bfee-48c6-a9f7-a0af7fe70018 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.159067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d75a8-bfee-48c6-a9f7-a0af7fe70018 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.159336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d75a8-bfee-48c6-a9f7-a0af7fe70018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.189004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93cac4-8ec8-44d0-bcef-7f225507176e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.225187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.226023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.226284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.226550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.227203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.228557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.229302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d75a8-bfee-48c6-a9f7-a0af7fe70018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.230876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d75a8-bfee-48c6-a9f7-a0af7fe70018 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:36.240104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:36.241403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:36.242490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:36.248642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 501/979] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:36.249296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.337293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 479/980] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 17:27:36.342631 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d75a8-bfee-48c6-a9f7-a0af7fe70018 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.362241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d54ab-b599-49da-9de2-f066365a36c5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.395311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.395978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.396256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.396525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.397238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:36.397537 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.398936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.404367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 502/981] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:36.409741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.448045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d75a8-bfee-48c6-a9f7-a0af7fe70018 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.480811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.481791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.482136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.482471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.493760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.495323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.506589 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bbcff-f7a3-472a-9fe9-e41e73d4d0e5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:36.512458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:36.513927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:36.515047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:36.515047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:36.515047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:36.515047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:36.517866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 480/982] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:36.519705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.541334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.542323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.542600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.542875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.543578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:36.543876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.545239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.552531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 503/983] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:36.559361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.618267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f609e-dc5b-4a02-b89a-673ae86f6d53 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.651219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.652033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.652386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.652748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.653533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:36.653921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.655348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e8f4-e439-4d3d-84c3-3329592422e8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.655505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.666833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 481/984] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:36.672241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.688416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.689159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.689502 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.689863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.690715 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] RBAC: Adding query filter params (interface=public, service_id=c4866fe5e55d46b89e41dc6f4cf75498, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:36.691088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.692509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.701974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 504/985] 10.222.0.58 () {56 vars in 1251 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/endpoints?service_id=c4866fe5e55d46b89e41dc6f4cf75498&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:36.703058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.768542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3685a-8087-4013-b8d8-1c85c7cae311 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.801901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c23426-ab03-4d25-86d5-4d18f0e35093 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.802838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.803634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.803913 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.804177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.810747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.812182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:36.825920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:36.826938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:36.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:36.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:36.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:36.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:36.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:36.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:36.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:36.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:36.831948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 482/986] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:36.832766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:36.836267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37933d-ffe5-4221-833e-3640a51aa73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.836951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37933d-ffe5-4221-833e-3640a51aa73c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.837227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37933d-ffe5-4221-833e-3640a51aa73c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.837498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37933d-ffe5-4221-833e-3640a51aa73c None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.838203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37933d-ffe5-4221-833e-3640a51aa73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.839632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37933d-ffe5-4221-833e-3640a51aa73c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.853574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 505/987] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:27:36.932253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c725-938a-46c3-91f1-6e2a3d7fcbcf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:36.968559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ef50-afda-4e80-b68b-8604b6050052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:36.969242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ef50-afda-4e80-b68b-8604b6050052 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:36.969516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ef50-afda-4e80-b68b-8604b6050052 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:36.969814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ef50-afda-4e80-b68b-8604b6050052 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:36.970605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447ef50-afda-4e80-b68b-8604b6050052 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:36.970910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447ef50-afda-4e80-b68b-8604b6050052 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:36.972348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447ef50-afda-4e80-b68b-8604b6050052 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:36.985260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 483/988] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:36.991472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37933d-ffe5-4221-833e-3640a51aa73c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:37.094131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37933d-ffe5-4221-833e-3640a51aa73c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:37.131392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52280149-c929-4403-ad87-7ce60e4caac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:37.132050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280149-c929-4403-ad87-7ce60e4caac3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:37.132363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280149-c929-4403-ad87-7ce60e4caac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:37.132641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280149-c929-4403-ad87-7ce60e4caac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:37.133468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52280149-c929-4403-ad87-7ce60e4caac3 None admin] RBAC: Adding query filter params (role.id=a925cb2cd7f64798b237f417c313fb5c, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=8a71982b29f447899a3d06885cf237bd) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:37.133806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52280149-c929-4403-ad87-7ce60e4caac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:37.135235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52280149-c929-4403-ad87-7ce60e4caac3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:37.141309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 506/989] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:36 2022] GET /identity/v3/role_assignments?user.id=8a71982b29f447899a3d06885cf237bd&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=a925cb2cd7f64798b237f417c313fb5c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:38.097596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e1dc-fd11-414e-9468-1db434e1caaf None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:38.098188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e1dc-fd11-414e-9468-1db434e1caaf None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:38.098188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e1dc-fd11-414e-9468-1db434e1caaf None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:38.099475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 484/990] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:38.105207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff112-6293-44ea-87cb-8f79248ac05d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:38.105671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff112-6293-44ea-87cb-8f79248ac05d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:38.105775 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff112-6293-44ea-87cb-8f79248ac05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:38.122435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f28ff112-6293-44ea-87cb-8f79248ac05d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:38.123581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f28ff112-6293-44ea-87cb-8f79248ac05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:38.194951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 507/991] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:38.216940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29e1dc-fd11-414e-9468-1db434e1caaf None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:38.323095 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29e1dc-fd11-414e-9468-1db434e1caaf None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:38.354320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:38.355383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:38.355853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:38.356321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:38.357508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:38.359772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:38.373476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:38.374882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:38.375807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 485/992] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:38.381597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff112-6293-44ea-87cb-8f79248ac05d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:38.473866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff112-6293-44ea-87cb-8f79248ac05d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:38.507482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:38.508130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:38.508372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:38.508665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:38.509355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:38.509679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:38.511092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:38.516138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 508/993] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:38.521815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:38.617291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b53b2-4f15-4839-a12a-9d4258bececb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:38.650560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:38.651350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:38.651683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:38.651950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:38.652649 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:38.652947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:38.654338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:38.659284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 486/994] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:38.665038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:38.762129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364cfe-c503-4489-9234-c70a947384e0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:38.796006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861faf6-2038-46a7-a524-008968263ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:38.796664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861faf6-2038-46a7-a524-008968263ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:38.796938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861faf6-2038-46a7-a524-008968263ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:38.797166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861faf6-2038-46a7-a524-008968263ef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:38.798021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861faf6-2038-46a7-a524-008968263ef4 None admin] RBAC: Adding query filter params (interface=admin, service_id=900f701c85674acaa3535ebb12b52088, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:38.798328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861faf6-2038-46a7-a524-008968263ef4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:38.799682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861faf6-2038-46a7-a524-008968263ef4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:38.805354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 509/995] 10.222.0.58 () {56 vars in 1249 bytes} [Mon May 16 17:27:38 2022] GET /identity/v3/endpoints?service_id=900f701c85674acaa3535ebb12b52088&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:38.810900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:38.912610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6ccf4-81a1-43b3-a554-a4f45f5d659f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:38.947638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4ca3a-e10e-428a-8c29-88010982f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:38.948342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4ca3a-e10e-428a-8c29-88010982f17f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:38.948735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4ca3a-e10e-428a-8c29-88010982f17f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:38.949009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4ca3a-e10e-428a-8c29-88010982f17f None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:38.949720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4ca3a-e10e-428a-8c29-88010982f17f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:38.951087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4ca3a-e10e-428a-8c29-88010982f17f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:38.965819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 487/996] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:27:38 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:27:39.075439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44ec0-ede2-42f5-a935-d7c88df5a0bb None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.075794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44ec0-ede2-42f5-a935-d7c88df5a0bb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.076023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44ec0-ede2-42f5-a935-d7c88df5a0bb None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.077492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 510/997] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:39.083558 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84da7-fe57-4e9b-be9a-f52112cc5b14 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.083865 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84da7-fe57-4e9b-be9a-f52112cc5b14 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.084114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84da7-fe57-4e9b-be9a-f52112cc5b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.102309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b9b84da7-fe57-4e9b-be9a-f52112cc5b14 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:39.103518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b9b84da7-fe57-4e9b-be9a-f52112cc5b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:39.173706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 488/998] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:39.196714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f44ec0-ede2-42f5-a935-d7c88df5a0bb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:39.308582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f44ec0-ede2-42f5-a935-d7c88df5a0bb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:39.346574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a729816-f776-4864-bc9e-38202c06dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:39.347381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729816-f776-4864-bc9e-38202c06dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.347661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729816-f776-4864-bc9e-38202c06dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.347937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729816-f776-4864-bc9e-38202c06dcb0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.348593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a729816-f776-4864-bc9e-38202c06dcb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:39.350005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a729816-f776-4864-bc9e-38202c06dcb0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0a729816-f776-4864-bc9e-38202c06dcb0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:39.362668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:39.364282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:39.365220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 511/999] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:39.372393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b84da7-fe57-4e9b-be9a-f52112cc5b14 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:39.377792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed008-164e-40dd-a2b7-35081ea87c82 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.378078 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed008-164e-40dd-a2b7-35081ea87c82 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.378316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed008-164e-40dd-a2b7-35081ea87c82 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.379886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 512/1000] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:39.385067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29bcaf-39f4-48d0-990a-9115039b19a0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.385349 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29bcaf-39f4-48d0-990a-9115039b19a0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.385648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29bcaf-39f4-48d0-990a-9115039b19a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.404806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2f29bcaf-39f4-48d0-990a-9115039b19a0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:39.407144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2f29bcaf-39f4-48d0-990a-9115039b19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:39.491600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b84da7-fe57-4e9b-be9a-f52112cc5b14 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:39.493935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 513/1001] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:39.515442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29bcaf-39f4-48d0-990a-9115039b19a0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:39.527540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:39.528210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.528489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.528728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.529447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:39.529780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:39.531142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:39.536152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 489/1002] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:39.541399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:39.613106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29bcaf-39f4-48d0-990a-9115039b19a0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:39.639177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b136d9-5968-4bb0-b235-cc42c9208e3d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:39.646729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:39.647519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.647794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.648046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] PATH_INFO: `/v3/services/image` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.648707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:39.650108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:39.661426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:39.662580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:39.663451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 514/1003] 10.222.0.58 () {56 vars in 1105 bytes} [Mon May 16 17:27:39 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:39.668577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:39.676647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:39.677312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.677595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.677870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.678596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:39.678898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:39.680259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:39.685226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 490/1004] 10.222.0.58 () {56 vars in 1112 bytes} [Mon May 16 17:27:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:39.690503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:39.764782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe2605-495e-46cb-a858-20856b3fddae None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:39.784408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde886-05ba-429a-9461-933af3be99b1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:39.797319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:39.798019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.798300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.798572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.799276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:39.799581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:39.801271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:39.806162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 515/1005] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:39.811497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:39.817144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d965392-86cc-41c7-9ac2-6530e120142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:39.817830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965392-86cc-41c7-9ac2-6530e120142a None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.818108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965392-86cc-41c7-9ac2-6530e120142a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.818375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965392-86cc-41c7-9ac2-6530e120142a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.819106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d965392-86cc-41c7-9ac2-6530e120142a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:39.820460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d965392-86cc-41c7-9ac2-6530e120142a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:39.839625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 491/1006] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:27:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:27:39.915440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745639-4b63-4086-a7ae-540079febbe5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:39.956508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80749ba8-f35d-4602-8de5-3049c21f39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:39.957178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80749ba8-f35d-4602-8de5-3049c21f39c2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:39.957452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80749ba8-f35d-4602-8de5-3049c21f39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:39.957747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80749ba8-f35d-4602-8de5-3049c21f39c2 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:39.958448 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80749ba8-f35d-4602-8de5-3049c21f39c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:39.958747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80749ba8-f35d-4602-8de5-3049c21f39c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:39.960119 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80749ba8-f35d-4602-8de5-3049c21f39c2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:39.973926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 516/1007] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:41.174451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5be531-8940-40d7-a217-ffb3b4f33571 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:41.174986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5be531-8940-40d7-a217-ffb3b4f33571 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:41.174986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5be531-8940-40d7-a217-ffb3b4f33571 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:41.176707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 492/1008] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:41.182201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cdb7b-6ad3-49ce-8c01-39b5bab8fe77 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:41.182619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cdb7b-6ad3-49ce-8c01-39b5bab8fe77 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:41.182803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cdb7b-6ad3-49ce-8c01-39b5bab8fe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:41.199947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a15cdb7b-6ad3-49ce-8c01-39b5bab8fe77 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:41.201521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a15cdb7b-6ad3-49ce-8c01-39b5bab8fe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:41.268495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 517/1009] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:41 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:41.296563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5be531-8940-40d7-a217-ffb3b4f33571 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:41.397065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5be531-8940-40d7-a217-ffb3b4f33571 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:41.430938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:41.431667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:41.431943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:41.432214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:41.432907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:41.434312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:41.445996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:41.447047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:41.453277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 493/1010] 10.222.0.58 () {56 vars in 1126 bytes} [Mon May 16 17:27:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:41.454284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cdb7b-6ad3-49ce-8c01-39b5bab8fe77 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:41.559205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cdb7b-6ad3-49ce-8c01-39b5bab8fe77 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:41.593164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:41.593868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:41.594131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:41.594398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:41.595087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:41.595390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:41.596750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:41.601657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 518/1011] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:41.607258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:41.706626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84479-5c0c-4efb-9728-589b853d030e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:41.740451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567bbe-3041-4686-82ee-57d56e36be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:41.741111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567bbe-3041-4686-82ee-57d56e36be7d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:41.741397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567bbe-3041-4686-82ee-57d56e36be7d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:41.741673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567bbe-3041-4686-82ee-57d56e36be7d None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:41.742364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73567bbe-3041-4686-82ee-57d56e36be7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:41.742663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73567bbe-3041-4686-82ee-57d56e36be7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:41.744016 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73567bbe-3041-4686-82ee-57d56e36be7d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:41.748996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 494/1012] 10.222.0.58 () {56 vars in 1122 bytes} [Mon May 16 17:27:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:41.754609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:41.851510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253da41-9689-4882-9ca3-158d54b25cee None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:41.888517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e51f1-9ad4-4810-834f-bfb29e6122e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:41.889223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e51f1-9ad4-4810-834f-bfb29e6122e0 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:41.889506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e51f1-9ad4-4810-834f-bfb29e6122e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:41.889840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e51f1-9ad4-4810-834f-bfb29e6122e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:41.890576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e51f1-9ad4-4810-834f-bfb29e6122e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:41.891945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e51f1-9ad4-4810-834f-bfb29e6122e0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:41.915498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 519/1013] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:27:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:42.155586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b2128-6825-4eec-b2f0-7e221454ec0e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.156003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b2128-6825-4eec-b2f0-7e221454ec0e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.156111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b2128-6825-4eec-b2f0-7e221454ec0e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.157684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 495/1014] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:42.162993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9393e-908c-4071-90b3-ab955b87ff91 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.163246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9393e-908c-4071-90b3-ab955b87ff91 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.163569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9393e-908c-4071-90b3-ab955b87ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.180888 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1bb9393e-908c-4071-90b3-ab955b87ff91 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:42.182155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1bb9393e-908c-4071-90b3-ab955b87ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:42.183648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd320c-d917-436a-b3ba-1662d9868903 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.184126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd320c-d917-436a-b3ba-1662d9868903 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.184204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd320c-d917-436a-b3ba-1662d9868903 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.185722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 496/1015] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:42.190544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876c2ae-e90f-4237-86c8-3f40d66f4466 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.190791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876c2ae-e90f-4237-86c8-3f40d66f4466 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.191102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876c2ae-e90f-4237-86c8-3f40d66f4466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.208481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8876c2ae-e90f-4237-86c8-3f40d66f4466 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:42.209689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8876c2ae-e90f-4237-86c8-3f40d66f4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:42.261593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 520/1016] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:42.278307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 497/1017] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:42.280306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9393e-908c-4071-90b3-ab955b87ff91 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:42.301197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876c2ae-e90f-4237-86c8-3f40d66f4466 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:42.380840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9393e-908c-4071-90b3-ab955b87ff91 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:42.397884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876c2ae-e90f-4237-86c8-3f40d66f4466 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:42.415830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd90f6-2d14-4f9f-8a55-b127248f0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:42.416429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd90f6-2d14-4f9f-8a55-b127248f0723 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.416702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd90f6-2d14-4f9f-8a55-b127248f0723 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.417031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd90f6-2d14-4f9f-8a55-b127248f0723 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.417805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd90f6-2d14-4f9f-8a55-b127248f0723 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:42.419166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd90f6-2d14-4f9f-8a55-b127248f0723 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:42.441058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 521/1018] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:27:42 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:42.450671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430528c-ecf6-4ade-84ec-6e1335c0cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:42.451509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430528c-ecf6-4ade-84ec-6e1335c0cf38 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.451785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430528c-ecf6-4ade-84ec-6e1335c0cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.452051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430528c-ecf6-4ade-84ec-6e1335c0cf38 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.463776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430528c-ecf6-4ade-84ec-6e1335c0cf38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a430528c-ecf6-4ade-84ec-6e1335c0cf38 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:42.472131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:42.473157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:42.474077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 498/1019] 10.222.0.58 () {56 vars in 1120 bytes} [Mon May 16 17:27:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:42.479543 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd90f6-2d14-4f9f-8a55-b127248f0723 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:42.584764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd90f6-2d14-4f9f-8a55-b127248f0723 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:42.619784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:42.620496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.620773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.621044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.621837 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:42.622120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:42.623566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:42.631934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 522/1020] 10.222.0.58 () {56 vars in 1115 bytes} [Mon May 16 17:27:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:42.637626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430528c-ecf6-4ade-84ec-6e1335c0cf38 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:42.734104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430528c-ecf6-4ade-84ec-6e1335c0cf38 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:42.766662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:42.767454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.767729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.767954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.778673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:42.780102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:42.796725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:42.797724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:42.798625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:42.798625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:42.798625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:42.798625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:42.799324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 499/1021] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:42.804276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:42.902049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dd428-8985-479e-9724-9dd47b46610a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:42.935583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:42.936238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:42.936513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:42.936780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:42.937474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:42.937803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:42.939158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:42.951178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 523/1022] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:42.956859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:43.055210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764695d-f6a2-444f-8f1d-4eee0a54dc5e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:43.088363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:43.089198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:43.089475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:43.089745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:43.097226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:43.098684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:43.113802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:43.115981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:43.118257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 500/1023] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:27:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:43.119584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:43.224954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d393f-4ee2-4409-aa2d-95b372531c68 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:43.259042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:43.259718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:43.259999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:43.260268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:43.261167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:43.261487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:43.262964 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:43.280399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 524/1024] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:27:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:43.285915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:43.389436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b36fa-6ef5-427f-a9ce-651fc01406d2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:43.422137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6021a-47aa-4792-9b2d-31798dc4fa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:43.422772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6021a-47aa-4792-9b2d-31798dc4fa5d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:43.423052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6021a-47aa-4792-9b2d-31798dc4fa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:43.423327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6021a-47aa-4792-9b2d-31798dc4fa5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:43.489161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6021a-47aa-4792-9b2d-31798dc4fa5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:43.490638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6021a-47aa-4792-9b2d-31798dc4fa5d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:43.592169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 501/1025] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:43.598068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:43.692397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dccd1-0ab2-4430-b2d0-433001f70277 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:43.726440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:43.727230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:43.727508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:43.727782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:43.737707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:43.739155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:43.756752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:43.757974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:43.758915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:43.758915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:43.758915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:43.758915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:43.761666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 525/1026] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:43.763732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6021a-47aa-4792-9b2d-31798dc4fa5d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:43.861994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6021a-47aa-4792-9b2d-31798dc4fa5d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:43.896068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:43.896734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:43.897013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:43.897283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:43.898022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:43.898341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:43.899701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:43.911358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 502/1027] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:43.916894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:44.021059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613190fc-6ca1-418a-abb5-cfd2513312fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:44.056476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd4b3-6bf9-4f1b-984f-815212256815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:44.057272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd4b3-6bf9-4f1b-984f-815212256815 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.057597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd4b3-6bf9-4f1b-984f-815212256815 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.057886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd4b3-6bf9-4f1b-984f-815212256815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.064554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cd4b3-6bf9-4f1b-984f-815212256815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:44.066044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cd4b3-6bf9-4f1b-984f-815212256815 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-724cd4b3-6bf9-4f1b-984f-815212256815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:44.079433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:44.080340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:44.081247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:44.081247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:44.081247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:44.081247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:44.081247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:44.081247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:44.081247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:44.081247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:44.085638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 526/1028] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:44.086845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:44.133192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da11c8-eb45-4faf-8023-9ffc02f4f13f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.133441 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da11c8-eb45-4faf-8023-9ffc02f4f13f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.133754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da11c8-eb45-4faf-8023-9ffc02f4f13f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.135268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 527/1029] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:44.140227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eafdc7-0e6d-4980-a78e-3d6eded3a38a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.140469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eafdc7-0e6d-4980-a78e-3d6eded3a38a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.140770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eafdc7-0e6d-4980-a78e-3d6eded3a38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.161866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-78eafdc7-0e6d-4980-a78e-3d6eded3a38a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:44.163065 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-78eafdc7-0e6d-4980-a78e-3d6eded3a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:44.188903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb371e4a-8a9c-453e-8a8c-a3e307898626 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:44.227765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:44.228435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.228720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.228978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.229911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:44.230218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:44.231680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:44.233948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 528/1030] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:44.245002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 503/1031] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:44.249899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eafdc7-0e6d-4980-a78e-3d6eded3a38a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:44.256690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:44.346872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eafdc7-0e6d-4980-a78e-3d6eded3a38a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:44.353752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e859c-86ae-49d8-b532-7fceefd89882 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:44.380347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:44.381033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.381310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.381611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.382450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] RBAC: Adding query filter params (role.id=a925cb2cd7f64798b237f417c313fb5c, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=a7263b80be2c437997b1a18002c9969d) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:44.383056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:44.384199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:44.389138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc9bb8-fddd-4f7a-a372-48deea10f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:44.398036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 529/1032] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:44 2022] GET /identity/v3/role_assignments?user.id=a7263b80be2c437997b1a18002c9969d&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=a925cb2cd7f64798b237f417c313fb5c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:44.398252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9bb8-fddd-4f7a-a372-48deea10f1bb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.398252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9bb8-fddd-4f7a-a372-48deea10f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.398252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9bb8-fddd-4f7a-a372-48deea10f1bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.398252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc9bb8-fddd-4f7a-a372-48deea10f1bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:44.398252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc9bb8-fddd-4f7a-a372-48deea10f1bb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:44.398252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 504/1033] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:44.400765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:44.515653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fbccd-9b92-43a4-938d-9471b69b16a8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:44.552981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008fc0f-7dd5-4afc-a117-da159ce75426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:44.553687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008fc0f-7dd5-4afc-a117-da159ce75426 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.553967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008fc0f-7dd5-4afc-a117-da159ce75426 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.554240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008fc0f-7dd5-4afc-a117-da159ce75426 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.554934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008fc0f-7dd5-4afc-a117-da159ce75426 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:44.556398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008fc0f-7dd5-4afc-a117-da159ce75426 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:44.584457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 530/1034] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:27:44 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:44.662625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21e70-c670-4fcc-908f-62a99fc12345 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.662804 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21e70-c670-4fcc-908f-62a99fc12345 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.663086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21e70-c670-4fcc-908f-62a99fc12345 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.664729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 505/1035] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:44.670410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4226b2-326d-414b-97af-5c6d9163315b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.670694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4226b2-326d-414b-97af-5c6d9163315b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.670970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4226b2-326d-414b-97af-5c6d9163315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.689740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3d4226b2-326d-414b-97af-5c6d9163315b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:44.690943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3d4226b2-326d-414b-97af-5c6d9163315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:44.761257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 531/1036] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:44.783934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21e70-c670-4fcc-908f-62a99fc12345 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:44.885919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21e70-c670-4fcc-908f-62a99fc12345 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:44.919573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:44.920778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:44.921303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:44.921799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] PATH_INFO: `/v3/services/image` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:44.922652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:44.924355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:44.936688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:44.937725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:44.938589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:44.939334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 506/1037] 10.222.0.58 () {56 vars in 1105 bytes} [Mon May 16 17:27:44 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:44.945320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4226b2-326d-414b-97af-5c6d9163315b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:45.043521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4226b2-326d-414b-97af-5c6d9163315b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:45.077827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:45.078492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:45.078773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:45.079040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:45.079762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] RBAC: Adding query filter params (name=image) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:45.080063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:45.081444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:45.091068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 532/1038] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:45.092811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:45.194804 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15168-8c0b-426a-aa70-68d96bb8e729 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:45.226827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:45.227507 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:45.227787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:45.228068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:45.228769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] RBAC: Adding query filter params (type=image) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:45.229075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:45.230508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:45.235819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 507/1039] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:45.241696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:45.348733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b315a-98cd-43e4-a522-14bfa0ddf153 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:45.383400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b52a27-e779-44f8-ba08-c9a65584e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:45.384070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52a27-e779-44f8-ba08-c9a65584e094 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:45.384345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52a27-e779-44f8-ba08-c9a65584e094 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:45.384610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52a27-e779-44f8-ba08-c9a65584e094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:45.385392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b52a27-e779-44f8-ba08-c9a65584e094 None admin] RBAC: Adding query filter params (interface=public, service_id=15f38f8e56664b0da4456fec92886829, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:45.385731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b52a27-e779-44f8-ba08-c9a65584e094 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:45.387097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b52a27-e779-44f8-ba08-c9a65584e094 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:45.396578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 533/1040] 10.222.0.58 () {56 vars in 1251 bytes} [Mon May 16 17:27:45 2022] GET /identity/v3/endpoints?service_id=15f38f8e56664b0da4456fec92886829&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:45.397635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:45.495542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb35c0-9186-49ca-86ae-96cdee28287e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:45.530123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1527c8a-2fe1-4770-a126-fe47640c1093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:45.530791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527c8a-2fe1-4770-a126-fe47640c1093 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:45.531065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527c8a-2fe1-4770-a126-fe47640c1093 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:45.531330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527c8a-2fe1-4770-a126-fe47640c1093 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:45.532009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1527c8a-2fe1-4770-a126-fe47640c1093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:45.533368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1527c8a-2fe1-4770-a126-fe47640c1093 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:45.540280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 508/1041] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:27:45 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:27:46.625016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50db9d-b6f4-4a92-845b-47ee45238c58 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:46.625861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50db9d-b6f4-4a92-845b-47ee45238c58 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:46.625861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50db9d-b6f4-4a92-845b-47ee45238c58 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:46.627128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 534/1042] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:46.632355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74be03-7b3c-45f6-83da-27dbd94934b7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:46.632778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74be03-7b3c-45f6-83da-27dbd94934b7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:46.632970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74be03-7b3c-45f6-83da-27dbd94934b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:46.651810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2c74be03-7b3c-45f6-83da-27dbd94934b7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:46.653077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2c74be03-7b3c-45f6-83da-27dbd94934b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:46.724162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 509/1043] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:46.746450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50db9d-b6f4-4a92-845b-47ee45238c58 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:46.841225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18ae1e-82fa-4b6a-878f-e03e442ad000 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:46.841473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18ae1e-82fa-4b6a-878f-e03e442ad000 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:46.841758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18ae1e-82fa-4b6a-878f-e03e442ad000 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:46.843256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 510/1044] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:46.848014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c944-7038-44aa-b644-3b86a59deaf9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:46.848281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c944-7038-44aa-b644-3b86a59deaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:46.848554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c944-7038-44aa-b644-3b86a59deaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:46.848713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50db9d-b6f4-4a92-845b-47ee45238c58 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:46.864310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d4b3c944-7038-44aa-b644-3b86a59deaf9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:46.865454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d4b3c944-7038-44aa-b644-3b86a59deaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:46.883146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e53a-c268-4dc4-9d45-f19e6c2db8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:46.883891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e53a-c268-4dc4-9d45-f19e6c2db8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:46.884165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e53a-c268-4dc4-9d45-f19e6c2db8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:46.884429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e53a-c268-4dc4-9d45-f19e6c2db8f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:46.895626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0e53a-c268-4dc4-9d45-f19e6c2db8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-11b0e53a-c268-4dc4-9d45-f19e6c2db8f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:46.906122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:46.907111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:46.907959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:46.909207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 535/1045] 10.222.0.58 () {56 vars in 1120 bytes} [Mon May 16 17:27:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:46.913202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e53a-c268-4dc4-9d45-f19e6c2db8f1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:46.933051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 511/1046] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:46.957151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c944-7038-44aa-b644-3b86a59deaf9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.016128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e53a-c268-4dc4-9d45-f19e6c2db8f1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:47.051197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c944-7038-44aa-b644-3b86a59deaf9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:47.057330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:47.058203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.059001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.059438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.060680 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:47.061153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:47.063283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:47.073739 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 536/1047] 10.222.0.58 () {56 vars in 1115 bytes} [Mon May 16 17:27:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:47.079147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.084931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5420e9-e7d1-4eac-8948-192e80fdc026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:47.087458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5420e9-e7d1-4eac-8948-192e80fdc026 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.087569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5420e9-e7d1-4eac-8948-192e80fdc026 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.088647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5420e9-e7d1-4eac-8948-192e80fdc026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.089366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5420e9-e7d1-4eac-8948-192e80fdc026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:47.093353 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5420e9-e7d1-4eac-8948-192e80fdc026 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:47.100425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 512/1048] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:47.101325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5420e9-e7d1-4eac-8948-192e80fdc026 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.209203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629350a-d6d1-4f31-be99-168e57659691 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:47.214085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5420e9-e7d1-4eac-8948-192e80fdc026 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:47.242857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:47.243726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.244004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.244272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.254925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:47.255974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3a6d-657d-4b11-b088-b1713242de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:47.256469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:47.257084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3a6d-657d-4b11-b088-b1713242de61 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.257572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3a6d-657d-4b11-b088-b1713242de61 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.258210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3a6d-657d-4b11-b088-b1713242de61 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.259449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3a6d-657d-4b11-b088-b1713242de61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:47.261204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3a6d-657d-4b11-b088-b1713242de61 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:47.274079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:47.275104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:47.282174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:47.282174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:47.282174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:47.282174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:47.282174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 537/1049] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:47.282528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.297367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 513/1050] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:27:47 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:47.394565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9918-8c50-4764-8ba0-8bd5fb734e7a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:47.429487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:47.430209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.430488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.430761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.431488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:47.431792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:47.433253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:47.449588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 538/1051] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:47.453140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3a6d-657d-4b11-b088-b1713242de61 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.576324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3a6d-657d-4b11-b088-b1713242de61 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:47.612394 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541c828-5d8b-4a05-b7d4-8bc4a0d2bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:47.613210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541c828-5d8b-4a05-b7d4-8bc4a0d2bacb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.613485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541c828-5d8b-4a05-b7d4-8bc4a0d2bacb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.613784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541c828-5d8b-4a05-b7d4-8bc4a0d2bacb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.621929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541c828-5d8b-4a05-b7d4-8bc4a0d2bacb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:47.623361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541c828-5d8b-4a05-b7d4-8bc4a0d2bacb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-9541c828-5d8b-4a05-b7d4-8bc4a0d2bacb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:47.636956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:47.638388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:47.639348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 514/1052] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:27:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:47.644182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.740677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277418ce-5960-4c44-890f-4733ae060eda None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:47.771754 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365dee-b9c5-4670-9ad4-3b1f3b02ec4e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.772015 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365dee-b9c5-4670-9ad4-3b1f3b02ec4e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.772283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365dee-b9c5-4670-9ad4-3b1f3b02ec4e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.773903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 515/1053] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:47.776834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:47.777522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.777847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.778127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.778959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:47.779240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b585-04db-4a58-91de-c73866d85fe5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.779367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:47.779569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b585-04db-4a58-91de-c73866d85fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.779837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b585-04db-4a58-91de-c73866d85fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.780677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:47.797174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-75d6b585-04db-4a58-91de-c73866d85fe5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:47.798368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-75d6b585-04db-4a58-91de-c73866d85fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:47.801601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 539/1054] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:27:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:47.804977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.868222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 516/1055] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:47.891050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6b585-04db-4a58-91de-c73866d85fe5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.901220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a5edf-0fc8-4541-942d-e2ad9af9086f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:47.934766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:47.935564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:47.935841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:47.936111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:47.945987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:47.947432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:47.964483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:47.965442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:47.966380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:47.966380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:47.966380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:47.966380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:47.966380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 540/1056] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:47.971292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:47.994663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6b585-04db-4a58-91de-c73866d85fe5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:48.028082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:48.028871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:48.029148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:48.029415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] PATH_INFO: `/v3/services/image` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:48.030082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:48.031448 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:48.042676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:48.043658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 17:27:48.044748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:48.048948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 517/1057] 10.222.0.58 () {56 vars in 1105 bytes} [Mon May 16 17:27:47 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:48.049829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:48.074540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41250f-50e2-4b56-98b1-10f6f9384946 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:48.113767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:48.114427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:48.114706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:48.114975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:48.115687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:48.115988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:48.117352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:48.132273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 541/1058] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:48.137368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:48.154502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4df94-fea5-4f53-ae6b-cbffd29acf59 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:48.188505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:48.189167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:48.189870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:48.190148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:48.191113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] RBAC: Adding query filter params (name=image) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:48.191416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:48.193256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:48.198490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 518/1059] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:48.204498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:48.235189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132b68-b5ce-4d98-bd83-a193a07b6083 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:48.266721 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:48.267506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:48.267778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:48.268043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:48.274461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:48.275895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:48.290089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:48.290989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:48.291940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:48.291940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:48.291940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:48.291940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:48.291940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:48.291940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:48.291940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:48.291940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:48.293864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 542/1060] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:48.296904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:48.305500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d74a8-a7ed-49c1-a67c-ae4076fdb88c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:48.337687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:48.338703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:48.338966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:48.339256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:48.339975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] RBAC: Adding query filter params (type=image) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:48.340276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:48.341663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:48.351347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 519/1061] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:48.352020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:48.392892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8afdd-be79-46e7-857b-641d9b7e9a35 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:48.425620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:48.426381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:48.426954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:48.427065 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:48.427891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:48.428296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:48.429880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:48.446410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 543/1062] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:48.446674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398e65-899b-4aae-b34c-fbcdc688a78c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:48.447398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:48.482991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28057225-5ef0-4f85-bf06-bf3cd3470edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:48.483663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28057225-5ef0-4f85-bf06-bf3cd3470edf None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:48.483936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28057225-5ef0-4f85-bf06-bf3cd3470edf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:48.484201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28057225-5ef0-4f85-bf06-bf3cd3470edf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:48.484940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28057225-5ef0-4f85-bf06-bf3cd3470edf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:48.486380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28057225-5ef0-4f85-bf06-bf3cd3470edf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:48.514036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 520/1063] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:27:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:27:48.563100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46e9cd-be6f-4c08-bc19-d9a30853e482 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:48.606152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51396eef-6f27-46fd-8262-c0ad8cd11895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:48.607070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396eef-6f27-46fd-8262-c0ad8cd11895 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:48.607345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396eef-6f27-46fd-8262-c0ad8cd11895 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:48.607615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396eef-6f27-46fd-8262-c0ad8cd11895 None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/a7263b80be2c437997b1a18002c9969d/roles/a925cb2cd7f64798b237f417c313fb5c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:48.610024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51396eef-6f27-46fd-8262-c0ad8cd11895 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=a7263b80be2c437997b1a18002c9969d, role_id=a925cb2cd7f64798b237f417c313fb5c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:48.611477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51396eef-6f27-46fd-8262-c0ad8cd11895 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:48.627141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 544/1064] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:27:48 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/a7263b80be2c437997b1a18002c9969d/roles/a925cb2cd7f64798b237f417c313fb5c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:27:49.630138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68302-e57b-47b2-8ea5-93d8b20e9f6b None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:49.630688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68302-e57b-47b2-8ea5-93d8b20e9f6b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:49.630688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68302-e57b-47b2-8ea5-93d8b20e9f6b None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:49.632214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 521/1065] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:49.637587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf693-599b-431a-8abb-282d6a6ce5ad None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:49.638102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf693-599b-431a-8abb-282d6a6ce5ad None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:49.638177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf693-599b-431a-8abb-282d6a6ce5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:49.656133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-83edf693-599b-431a-8abb-282d6a6ce5ad None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:49.657335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-83edf693-599b-431a-8abb-282d6a6ce5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:49.725001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 545/1066] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:49.748814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb68302-e57b-47b2-8ea5-93d8b20e9f6b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:49.851090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb68302-e57b-47b2-8ea5-93d8b20e9f6b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:49.884386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382fff-33e6-497c-9464-4e129be47ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:49.885107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382fff-33e6-497c-9464-4e129be47ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:49.885437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382fff-33e6-497c-9464-4e129be47ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:49.885738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382fff-33e6-497c-9464-4e129be47ad4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:49.896048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae382fff-33e6-497c-9464-4e129be47ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ae382fff-33e6-497c-9464-4e129be47ad4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:49.903562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:49.904498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:49.905350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 522/1067] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:49.910921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf693-599b-431a-8abb-282d6a6ce5ad None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:50.008092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf693-599b-431a-8abb-282d6a6ce5ad None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:50.041388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:50.042434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.042891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.043333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.044247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:50.044723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:50.046305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:50.059643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 546/1068] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:50.061247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382fff-33e6-497c-9464-4e129be47ad4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:50.156381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382fff-33e6-497c-9464-4e129be47ad4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:50.191306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e399-a4ee-4de5-91f7-27861512bd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:50.192177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e399-a4ee-4de5-91f7-27861512bd40 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.192453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e399-a4ee-4de5-91f7-27861512bd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.192723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e399-a4ee-4de5-91f7-27861512bd40 None admin] PATH_INFO: `/v3/users/fae00ef69b724c4d9665c5a5e6bade5e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.206469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5e399-a4ee-4de5-91f7-27861512bd40 None admin] RBAC: Authorizing `identity:get_user(user_id=fae00ef69b724c4d9665c5a5e6bade5e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:50.207917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5e399-a4ee-4de5-91f7-27861512bd40 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:50.214369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 523/1069] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:27:50 2022] GET /identity/v3/users/fae00ef69b724c4d9665c5a5e6bade5e => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:50.215975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:50.316501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b848645-9cae-4158-9ed9-083d2bf2fe46 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:50.350445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92dcfa-f35a-4010-bdef-5a858ea48276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:50.351071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92dcfa-f35a-4010-bdef-5a858ea48276 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.351373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92dcfa-f35a-4010-bdef-5a858ea48276 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.351608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92dcfa-f35a-4010-bdef-5a858ea48276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.419775 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92dcfa-f35a-4010-bdef-5a858ea48276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:50.421134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92dcfa-f35a-4010-bdef-5a858ea48276 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:50.520180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 547/1070] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:50.526185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e399-a4ee-4de5-91f7-27861512bd40 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:50.642866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e399-a4ee-4de5-91f7-27861512bd40 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:50.680053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0de7b6-c186-4579-8cbd-3f24db80f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:50.680830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de7b6-c186-4579-8cbd-3f24db80f994 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.681109 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de7b6-c186-4579-8cbd-3f24db80f994 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.681381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de7b6-c186-4579-8cbd-3f24db80f994 None admin] PATH_INFO: `/v3/projects/e007cae75b544f669837b2bee57a4ff6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.682637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0de7b6-c186-4579-8cbd-3f24db80f994 None admin] RBAC: Authorizing `identity:get_project(project_id=e007cae75b544f669837b2bee57a4ff6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:50.684067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0de7b6-c186-4579-8cbd-3f24db80f994 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:50.686014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 524/1071] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:27:50 2022] GET /identity/v3/projects/e007cae75b544f669837b2bee57a4ff6 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:50.692198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92dcfa-f35a-4010-bdef-5a858ea48276 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:50.741712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce330a6-2719-4ce5-8e1b-0b6f8c69747d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.742047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce330a6-2719-4ce5-8e1b-0b6f8c69747d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.742232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce330a6-2719-4ce5-8e1b-0b6f8c69747d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.743755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 525/1072] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:50.748612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3b683-fad8-4bd4-80b3-91df8b93e551 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.748897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3b683-fad8-4bd4-80b3-91df8b93e551 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.749175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3b683-fad8-4bd4-80b3-91df8b93e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.765365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bcc3b683-fad8-4bd4-80b3-91df8b93e551 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:50.766567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bcc3b683-fad8-4bd4-80b3-91df8b93e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:50.792592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92dcfa-f35a-4010-bdef-5a858ea48276 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:50.826800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:50.827453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.827731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.828003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.828824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=e007cae75b544f669837b2bee57a4ff6, user.id=fae00ef69b724c4d9665c5a5e6bade5e) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:50.829131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:50.830609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:50.832053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 526/1073] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:50.833359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c41d35-6617-401c-8dbf-06220c014716 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.833684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c41d35-6617-401c-8dbf-06220c014716 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.833969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c41d35-6617-401c-8dbf-06220c014716 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.835360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 527/1074] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:50.836242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 548/1075] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:50 2022] GET /identity/v3/role_assignments?user.id=fae00ef69b724c4d9665c5a5e6bade5e&scope.project.id=e007cae75b544f669837b2bee57a4ff6&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:50.840484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ff55a-fcef-4c52-9e3c-441b851e05d4 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.840771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ff55a-fcef-4c52-9e3c-441b851e05d4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.841046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ff55a-fcef-4c52-9e3c-441b851e05d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:50.854652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:50.859416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3c0ff55a-fcef-4c52-9e3c-441b851e05d4 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:50.860618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3c0ff55a-fcef-4c52-9e3c-441b851e05d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:50.932654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 528/1076] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:50.956008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ff55a-fcef-4c52-9e3c-441b851e05d4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:50.958122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059dee2-af30-44c1-b12d-360feeb44ba7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:50.994073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944018a0-c9b3-4402-b20c-1cc5dd34694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:50.994800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944018a0-c9b3-4402-b20c-1cc5dd34694f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:50.995081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944018a0-c9b3-4402-b20c-1cc5dd34694f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:50.995353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944018a0-c9b3-4402-b20c-1cc5dd34694f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.057368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ff55a-fcef-4c52-9e3c-441b851e05d4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:51.072503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944018a0-c9b3-4402-b20c-1cc5dd34694f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:51.074487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944018a0-c9b3-4402-b20c-1cc5dd34694f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:51.089790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcb2c-c1f7-4af7-8fd0-fe4b3259335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:51.090605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcb2c-c1f7-4af7-8fd0-fe4b3259335d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:51.090883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcb2c-c1f7-4af7-8fd0-fe4b3259335d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:51.091154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcb2c-c1f7-4af7-8fd0-fe4b3259335d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.101980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dcb2c-c1f7-4af7-8fd0-fe4b3259335d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-927dcb2c-c1f7-4af7-8fd0-fe4b3259335d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:51.109969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:51.111124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 529/1077] 10.222.0.58 () {56 vars in 1120 bytes} [Mon May 16 17:27:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:51.117233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcb2c-c1f7-4af7-8fd0-fe4b3259335d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:51.179980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 549/1078] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:51.185699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944018a0-c9b3-4402-b20c-1cc5dd34694f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:51.219125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcb2c-c1f7-4af7-8fd0-fe4b3259335d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:51.252462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:51.253138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:51.253422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:51.253721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.255041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:51.255041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:51.256166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:51.268976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 530/1079] 10.222.0.58 () {56 vars in 1115 bytes} [Mon May 16 17:27:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:51.270066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:51.283871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944018a0-c9b3-4402-b20c-1cc5dd34694f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:51.316927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:51.317745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:51.318024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:51.318293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.328144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:51.329610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:51.346679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:51.347654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:51.348575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:51.348575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:51.348575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:51.348575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:51.352870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 550/1080] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:51.353528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:51.369194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705708d9-6fac-4010-8f07-b31b8786b162 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:51.402317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:51.403233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:51.403515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:51.403785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.414252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:51.415690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:51.433077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:51.434212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:51.440121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:51.440121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:51.440121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:51.440121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:51.440121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 531/1081] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:27:51.440121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:51.453381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979500e-aaf3-4e2c-afa8-d5083588cda1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:51.486660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:51.487323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:51.487591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:51.487865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.488584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:51.488887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:51.490307 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:51.501380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 551/1082] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:51.540757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2a599-a514-4d20-9f85-daf81e665506 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:51.577982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:51.578996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:51.579460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:51.579937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.580868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:51.581349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:51.582949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:51.596455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 532/1083] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:51.602315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:51.709608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eec69-1e74-4844-8df5-f63fcf810759 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:51.742339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:51.743124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:51.743414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:51.743684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.751289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:51.752747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:27:51.766574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:51.767559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:51.768529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 552/1084] 10.222.0.58 () {56 vars in 1093 bytes} [Mon May 16 17:27:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:51.773741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:51.868555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ad8e5-691a-4c60-8015-8b57ebe6749c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:51.901796 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:51.902463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:51.902744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:51.903020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:51.903865 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:51.904170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:51.905604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:51.923677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 533/1085] 10.222.0.58 () {56 vars in 1133 bytes} [Mon May 16 17:27:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:51.929857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:52.035271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c503ca-a88c-4b2a-8378-f516454d33cb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:52.070404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96247dd7-3017-41bd-9533-8c40034607dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:52.071054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96247dd7-3017-41bd-9533-8c40034607dd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:52.071333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96247dd7-3017-41bd-9533-8c40034607dd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:52.071609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96247dd7-3017-41bd-9533-8c40034607dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:52.137215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96247dd7-3017-41bd-9533-8c40034607dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:52.138701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96247dd7-3017-41bd-9533-8c40034607dd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:52.240154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 553/1086] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:52.246136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:52.345916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbff3-5ebb-40ff-a247-7b5349c4cbf0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:52.379596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:52.380384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:52.380659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:52.380930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:52.390914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:52.392346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:27:52.409746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:52.410788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:52.411697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:27:52.411697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:27:52.411697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:27:52.411697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:52.411697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 534/1087] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:52.416885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96247dd7-3017-41bd-9533-8c40034607dd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:52.517143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96247dd7-3017-41bd-9533-8c40034607dd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:52.551388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:52.552049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:52.552441 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:52.552771 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:52.553301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:52.553614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:52.554998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:52.566475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 554/1088] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:52.572322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:52.670927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86178e-1444-4167-87d1-0e6a0fd204ac None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:52.709923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:52.710715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:52.710997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:52.711264 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:52.718195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:52.719635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:27:52.733169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:52.734107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:52.735025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 535/1089] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:52.740433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:52.838469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c34122-82f3-4e5f-9e54-9f8d707b259c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:52.875373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5aeb2-7646-40ff-a5be-24f52d55ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:52.876045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5aeb2-7646-40ff-a5be-24f52d55ea17 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:52.876324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5aeb2-7646-40ff-a5be-24f52d55ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:52.876597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5aeb2-7646-40ff-a5be-24f52d55ea17 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:52.877376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5aeb2-7646-40ff-a5be-24f52d55ea17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:52.877678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5aeb2-7646-40ff-a5be-24f52d55ea17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:52.879145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5aeb2-7646-40ff-a5be-24f52d55ea17 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:52.891814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 555/1090] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:52.898075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:53.000200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cb532-019e-43de-9b42-1d1536716cd4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:53.029396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868ce0-ea21-4e11-947f-0c0773394846 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:53.029732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868ce0-ea21-4e11-947f-0c0773394846 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:53.030009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868ce0-ea21-4e11-947f-0c0773394846 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:53.031559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 556/1091] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:27:53.035479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:53.036130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:53.036402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:53.036533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f27544-927f-4531-8b0e-a8b32ba9c141 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:53.036633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:53.036718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f27544-927f-4531-8b0e-a8b32ba9c141 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:53.036961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f27544-927f-4531-8b0e-a8b32ba9c141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:53.037478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] RBAC: Adding query filter params (role.id=a925cb2cd7f64798b237f417c313fb5c, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=a7263b80be2c437997b1a18002c9969d) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:53.037813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:53.039229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:53.045091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 536/1092] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:52 2022] GET /identity/v3/role_assignments?user.id=a7263b80be2c437997b1a18002c9969d&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=a925cb2cd7f64798b237f417c313fb5c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:53.055521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-70f27544-927f-4531-8b0e-a8b32ba9c141 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:53.056752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-70f27544-927f-4531-8b0e-a8b32ba9c141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:53.130720 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 557/1093] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:27:53.153573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:53.260291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805e92-9aa5-48b7-91f6-03be535675a3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:53.292979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ff79-fd72-467c-af34-fd7c0acce103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:53.293797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ff79-fd72-467c-af34-fd7c0acce103 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:53.294075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ff79-fd72-467c-af34-fd7c0acce103 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:53.294347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ff79-fd72-467c-af34-fd7c0acce103 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:53.304398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11ff79-fd72-467c-af34-fd7c0acce103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ab11ff79-fd72-467c-af34-fd7c0acce103 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:53.312001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:53.312918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:27:53.313805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 537/1094] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:53.319485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f27544-927f-4531-8b0e-a8b32ba9c141 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:53.415418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f27544-927f-4531-8b0e-a8b32ba9c141 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:53.449915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:53.450584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:53.450858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:53.451125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:53.451902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:53.452195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:53.453587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:53.461536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 558/1095] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:53.467840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ff79-fd72-467c-af34-fd7c0acce103 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:53.562742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ff79-fd72-467c-af34-fd7c0acce103 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:53.600029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d6324-07fd-4e84-b316-f2edb88d24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:53.601477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d6324-07fd-4e84-b316-f2edb88d24eb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:53.601791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d6324-07fd-4e84-b316-f2edb88d24eb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:53.602068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d6324-07fd-4e84-b316-f2edb88d24eb None admin] PATH_INFO: `/v3/users/fae00ef69b724c4d9665c5a5e6bade5e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:53.603375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d6324-07fd-4e84-b316-f2edb88d24eb None admin] RBAC: Authorizing `identity:get_user(user_id=fae00ef69b724c4d9665c5a5e6bade5e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:53.605418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d6324-07fd-4e84-b316-f2edb88d24eb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:53.607625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 538/1096] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:27:53 2022] GET /identity/v3/users/fae00ef69b724c4d9665c5a5e6bade5e => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:53.613989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:53.721499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da43a-f0b5-424e-b553-3f67c580b2e9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:53.754615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9141e-1bd8-4323-bc67-580554d7f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:53.755520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9141e-1bd8-4323-bc67-580554d7f363 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:53.755800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9141e-1bd8-4323-bc67-580554d7f363 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:53.756076 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9141e-1bd8-4323-bc67-580554d7f363 None admin] PATH_INFO: `/v3/projects/e007cae75b544f669837b2bee57a4ff6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:53.757217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9141e-1bd8-4323-bc67-580554d7f363 None admin] RBAC: Authorizing `identity:get_project(project_id=e007cae75b544f669837b2bee57a4ff6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:53.758691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9141e-1bd8-4323-bc67-580554d7f363 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:53.760463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 559/1097] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:27:53 2022] GET /identity/v3/projects/e007cae75b544f669837b2bee57a4ff6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:53.766697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d6324-07fd-4e84-b316-f2edb88d24eb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:53.872546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d6324-07fd-4e84-b316-f2edb88d24eb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:53.907695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a6138-c28d-48ec-b4e5-8a7d1f4451d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:53.908590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6138-c28d-48ec-b4e5-8a7d1f4451d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:53.908864 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6138-c28d-48ec-b4e5-8a7d1f4451d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:53.909133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6138-c28d-48ec-b4e5-8a7d1f4451d2 None admin] PATH_INFO: `/v3/projects/e007cae75b544f669837b2bee57a4ff6/users/fae00ef69b724c4d9665c5a5e6bade5e/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:53.911164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a6138-c28d-48ec-b4e5-8a7d1f4451d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e007cae75b544f669837b2bee57a4ff6, user_id=fae00ef69b724c4d9665c5a5e6bade5e, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:53.912582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a6138-c28d-48ec-b4e5-8a7d1f4451d2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:53.927426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 539/1098] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:27:53 2022] PUT /identity/v3/projects/e007cae75b544f669837b2bee57a4ff6/users/fae00ef69b724c4d9665c5a5e6bade5e/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:27:56.169085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172e35-e8f7-4d18-a416-40727c5b7714 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:56.169648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172e35-e8f7-4d18-a416-40727c5b7714 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:56.169648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172e35-e8f7-4d18-a416-40727c5b7714 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:56.171030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 560/1099] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:56.176859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727364-6f87-4c61-857e-7e7325c7bdcd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:56.177274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727364-6f87-4c61-857e-7e7325c7bdcd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:56.177361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727364-6f87-4c61-857e-7e7325c7bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:56.196491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bd727364-6f87-4c61-857e-7e7325c7bdcd None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:56.197733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bd727364-6f87-4c61-857e-7e7325c7bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:56.271457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 540/1100] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:56.296528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172e35-e8f7-4d18-a416-40727c5b7714 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:56.401267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172e35-e8f7-4d18-a416-40727c5b7714 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:56.434875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53aba5-eda5-40b4-b8f3-73bccf55907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:56.435582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53aba5-eda5-40b4-b8f3-73bccf55907d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:56.435862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53aba5-eda5-40b4-b8f3-73bccf55907d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:56.436131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53aba5-eda5-40b4-b8f3-73bccf55907d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:56.447097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53aba5-eda5-40b4-b8f3-73bccf55907d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-aa53aba5-eda5-40b4-b8f3-73bccf55907d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:27:56.454586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:27:56.455597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:27:56.456806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 561/1101] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:27:56.461828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727364-6f87-4c61-857e-7e7325c7bdcd None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:56.579136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727364-6f87-4c61-857e-7e7325c7bdcd None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:56.615280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:56.615936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:56.616210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:56.616477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:56.617215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:56.617525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:56.618916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:56.627004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 541/1102] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:56.632958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53aba5-eda5-40b4-b8f3-73bccf55907d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:56.732049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53aba5-eda5-40b4-b8f3-73bccf55907d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:56.765700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76f91-8453-469f-8814-1bf43bf5b820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:56.766545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76f91-8453-469f-8814-1bf43bf5b820 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:56.766822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76f91-8453-469f-8814-1bf43bf5b820 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:56.767083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76f91-8453-469f-8814-1bf43bf5b820 None admin] PATH_INFO: `/v3/users/fae00ef69b724c4d9665c5a5e6bade5e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:56.768363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76f91-8453-469f-8814-1bf43bf5b820 None admin] RBAC: Authorizing `identity:get_user(user_id=fae00ef69b724c4d9665c5a5e6bade5e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:56.769818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76f91-8453-469f-8814-1bf43bf5b820 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:56.771411 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 562/1103] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:27:56 2022] GET /identity/v3/users/fae00ef69b724c4d9665c5a5e6bade5e => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:56.777247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:56.885568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e546-a4df-4ee7-a980-491349cdc2cb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:56.924879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac0554-0c2a-42b7-8e01-3e8004706073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:56.925859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0554-0c2a-42b7-8e01-3e8004706073 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:56.926133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0554-0c2a-42b7-8e01-3e8004706073 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:56.926396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0554-0c2a-42b7-8e01-3e8004706073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:56.991176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac0554-0c2a-42b7-8e01-3e8004706073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:56.992596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac0554-0c2a-42b7-8e01-3e8004706073 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:57.086769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 542/1104] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:27:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:27:57.096468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76f91-8453-469f-8814-1bf43bf5b820 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:57.207759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76f91-8453-469f-8814-1bf43bf5b820 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:57.246714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62564f-e7d9-4eec-bda8-ca6b31d63113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:57.247483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62564f-e7d9-4eec-bda8-ca6b31d63113 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:57.247751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62564f-e7d9-4eec-bda8-ca6b31d63113 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:57.248016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62564f-e7d9-4eec-bda8-ca6b31d63113 None admin] PATH_INFO: `/v3/projects/e007cae75b544f669837b2bee57a4ff6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:57.249297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62564f-e7d9-4eec-bda8-ca6b31d63113 None admin] RBAC: Authorizing `identity:get_project(project_id=e007cae75b544f669837b2bee57a4ff6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:57.250756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62564f-e7d9-4eec-bda8-ca6b31d63113 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:57.252416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 563/1105] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:27:57 2022] GET /identity/v3/projects/e007cae75b544f669837b2bee57a4ff6 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:57.261703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac0554-0c2a-42b7-8e01-3e8004706073 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:57.356728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac0554-0c2a-42b7-8e01-3e8004706073 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:57.390794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf81928-25d3-47ff-9708-5d8954007a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:57.392592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81928-25d3-47ff-9708-5d8954007a07 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:57.392724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81928-25d3-47ff-9708-5d8954007a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:57.392926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81928-25d3-47ff-9708-5d8954007a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:57.393767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf81928-25d3-47ff-9708-5d8954007a07 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=e007cae75b544f669837b2bee57a4ff6, user.id=fae00ef69b724c4d9665c5a5e6bade5e) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:27:57.394069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf81928-25d3-47ff-9708-5d8954007a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:57.395478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf81928-25d3-47ff-9708-5d8954007a07 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:57.401323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 543/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:27:57 2022] GET /identity/v3/role_assignments?user.id=fae00ef69b724c4d9665c5a5e6bade5e&scope.project.id=e007cae75b544f669837b2bee57a4ff6&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:27:59.628084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880578-deea-4f43-96e6-9f5d8f75ef7d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:59.629015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880578-deea-4f43-96e6-9f5d8f75ef7d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:59.629015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880578-deea-4f43-96e6-9f5d8f75ef7d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:59.631120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 564/1107] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:27:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:27:59.636521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7916-a2cb-4de5-b85a-e99093748756 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:59.636963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7916-a2cb-4de5-b85a-e99093748756 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:59.637061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7916-a2cb-4de5-b85a-e99093748756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:59.655065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9b0d7916-a2cb-4de5-b85a-e99093748756 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:27:59.656210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9b0d7916-a2cb-4de5-b85a-e99093748756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:27:59.721792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 544/1108] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:27:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:27:59.746482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e880578-deea-4f43-96e6-9f5d8f75ef7d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:27:59.853099 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e880578-deea-4f43-96e6-9f5d8f75ef7d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:27:59.890077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad684ea-f8c6-4645-80bf-292b96f76e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:27:59.890777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad684ea-f8c6-4645-80bf-292b96f76e33 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:27:59.891052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad684ea-f8c6-4645-80bf-292b96f76e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:27:59.891331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad684ea-f8c6-4645-80bf-292b96f76e33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:27:59.892491 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad684ea-f8c6-4645-80bf-292b96f76e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:27:59.893941 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad684ea-f8c6-4645-80bf-292b96f76e33 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:27:59.895534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 565/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:27:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:27:59.906812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7916-a2cb-4de5-b85a-e99093748756 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:00.026955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7916-a2cb-4de5-b85a-e99093748756 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:00.063654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99912ac-f532-4291-b785-7422b3b7c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:00.064320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99912ac-f532-4291-b785-7422b3b7c122 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:00.064600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99912ac-f532-4291-b785-7422b3b7c122 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:00.064875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99912ac-f532-4291-b785-7422b3b7c122 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:00.065595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99912ac-f532-4291-b785-7422b3b7c122 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:00.067035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99912ac-f532-4291-b785-7422b3b7c122 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:00.092081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 545/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:27:59 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:28:02.294695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca3a5-8cdd-479a-a657-d081e3c3b4fb None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:02.295195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca3a5-8cdd-479a-a657-d081e3c3b4fb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:02.295195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca3a5-8cdd-479a-a657-d081e3c3b4fb None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:02.296590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 566/1111] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:02.303246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905923d0-707c-4f24-be92-6ac2d18eb827 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:02.303690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905923d0-707c-4f24-be92-6ac2d18eb827 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:02.303787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905923d0-707c-4f24-be92-6ac2d18eb827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:02.323834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-905923d0-707c-4f24-be92-6ac2d18eb827 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:02.324997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-905923d0-707c-4f24-be92-6ac2d18eb827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:02.402090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 546/1112] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:02.437681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bca3a5-8cdd-479a-a657-d081e3c3b4fb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:02.548763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bca3a5-8cdd-479a-a657-d081e3c3b4fb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:02.582853 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ae27-42d2-48b7-ac71-c8fe702f5d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:02.583710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ae27-42d2-48b7-ac71-c8fe702f5d84 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:02.583966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ae27-42d2-48b7-ac71-c8fe702f5d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:02.584232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ae27-42d2-48b7-ac71-c8fe702f5d84 None admin] PATH_INFO: `/v3/roles/b2a32fa865d44fe48cd439137f78a12f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:02.585745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894ae27-42d2-48b7-ac71-c8fe702f5d84 None admin] RBAC: Authorizing `identity:get_role(role_id=b2a32fa865d44fe48cd439137f78a12f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:02.587113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894ae27-42d2-48b7-ac71-c8fe702f5d84 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:02.588559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 567/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:02 2022] GET /identity/v3/roles/b2a32fa865d44fe48cd439137f78a12f => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:02.594889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905923d0-707c-4f24-be92-6ac2d18eb827 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:02.707786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905923d0-707c-4f24-be92-6ac2d18eb827 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:02.743494 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe3732-d162-4191-81bf-61918b9ba7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:02.744377 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3732-d162-4191-81bf-61918b9ba7ee None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:02.744658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3732-d162-4191-81bf-61918b9ba7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:02.744929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3732-d162-4191-81bf-61918b9ba7ee None admin] PATH_INFO: `/v3/users/fa267c0ecba849639a0f3f88fc3d1ac4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:02.757951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe3732-d162-4191-81bf-61918b9ba7ee None admin] RBAC: Authorizing `identity:get_user(user_id=fa267c0ecba849639a0f3f88fc3d1ac4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:02.759396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe3732-d162-4191-81bf-61918b9ba7ee None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:02.761093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 547/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:02 2022] GET /identity/v3/users/fa267c0ecba849639a0f3f88fc3d1ac4 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:02.767361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ae27-42d2-48b7-ac71-c8fe702f5d84 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:02.863366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ae27-42d2-48b7-ac71-c8fe702f5d84 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:02.896909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4855c-ba51-4288-9fa0-72d6d31de56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:02.897541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4855c-ba51-4288-9fa0-72d6d31de56f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:02.897847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4855c-ba51-4288-9fa0-72d6d31de56f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:02.898123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4855c-ba51-4288-9fa0-72d6d31de56f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:02.981024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4855c-ba51-4288-9fa0-72d6d31de56f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:02.982520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4855c-ba51-4288-9fa0-72d6d31de56f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:03.079604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 568/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:28:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:28:03.086029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe3732-d162-4191-81bf-61918b9ba7ee None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:03.195045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe3732-d162-4191-81bf-61918b9ba7ee None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:03.236480 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca114e1-f1ae-4a89-ae5b-80da5c8308f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:03.237341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca114e1-f1ae-4a89-ae5b-80da5c8308f5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:03.237652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca114e1-f1ae-4a89-ae5b-80da5c8308f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:03.237930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca114e1-f1ae-4a89-ae5b-80da5c8308f5 None admin] PATH_INFO: `/v3/projects/e007cae75b544f669837b2bee57a4ff6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:03.239179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca114e1-f1ae-4a89-ae5b-80da5c8308f5 None admin] RBAC: Authorizing `identity:get_project(project_id=e007cae75b544f669837b2bee57a4ff6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:03.240618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca114e1-f1ae-4a89-ae5b-80da5c8308f5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:03.242352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 548/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:03 2022] GET /identity/v3/projects/e007cae75b544f669837b2bee57a4ff6 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:03.249612 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4855c-ba51-4288-9fa0-72d6d31de56f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:03.363488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4855c-ba51-4288-9fa0-72d6d31de56f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:03.397229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e155f-83ea-49df-91b6-a01cfc1a83de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:03.397907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e155f-83ea-49df-91b6-a01cfc1a83de None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:03.398185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e155f-83ea-49df-91b6-a01cfc1a83de None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:03.398457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e155f-83ea-49df-91b6-a01cfc1a83de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:03.399287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e155f-83ea-49df-91b6-a01cfc1a83de None admin] RBAC: Adding query filter params (role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=e007cae75b544f669837b2bee57a4ff6, user.id=fa267c0ecba849639a0f3f88fc3d1ac4) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:03.399595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e155f-83ea-49df-91b6-a01cfc1a83de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:03.401121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e155f-83ea-49df-91b6-a01cfc1a83de None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:03.406631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 569/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:28:03 2022] GET /identity/v3/role_assignments?user.id=fa267c0ecba849639a0f3f88fc3d1ac4&scope.project.id=e007cae75b544f669837b2bee57a4ff6&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:05.563428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d774b95-7bb8-4bb7-bfc2-8ad590fc9fb1 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:05.563976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d774b95-7bb8-4bb7-bfc2-8ad590fc9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:05.563976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d774b95-7bb8-4bb7-bfc2-8ad590fc9fb1 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:05.565359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 549/1118] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:05.571732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1c3b6-a4d5-4bd8-af8d-f7ff44b6c4b7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:05.572444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1c3b6-a4d5-4bd8-af8d-f7ff44b6c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:05.572597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1c3b6-a4d5-4bd8-af8d-f7ff44b6c4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:05.597259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-29b1c3b6-a4d5-4bd8-af8d-f7ff44b6c4b7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:05.598473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-29b1c3b6-a4d5-4bd8-af8d-f7ff44b6c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:05.677211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 570/1119] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:05.700352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d774b95-7bb8-4bb7-bfc2-8ad590fc9fb1 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:05.811428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d774b95-7bb8-4bb7-bfc2-8ad590fc9fb1 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:05.845108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dbaa9-8aea-47bf-adb9-59ac0d80e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:05.845911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dbaa9-8aea-47bf-adb9-59ac0d80e8fb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:05.846183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dbaa9-8aea-47bf-adb9-59ac0d80e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:05.846545 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dbaa9-8aea-47bf-adb9-59ac0d80e8fb None admin] PATH_INFO: `/v3/roles/b2a32fa865d44fe48cd439137f78a12f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:05.848148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dbaa9-8aea-47bf-adb9-59ac0d80e8fb None admin] RBAC: Authorizing `identity:get_role(role_id=b2a32fa865d44fe48cd439137f78a12f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:05.849512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dbaa9-8aea-47bf-adb9-59ac0d80e8fb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:05.850908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 550/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:05 2022] GET /identity/v3/roles/b2a32fa865d44fe48cd439137f78a12f => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:05.856952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1c3b6-a4d5-4bd8-af8d-f7ff44b6c4b7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:05.961307 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1c3b6-a4d5-4bd8-af8d-f7ff44b6c4b7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:06.003805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e8c0c-7e22-4300-9ae2-c11c52ce905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:06.004664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e8c0c-7e22-4300-9ae2-c11c52ce905e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:06.005026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e8c0c-7e22-4300-9ae2-c11c52ce905e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:06.005308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e8c0c-7e22-4300-9ae2-c11c52ce905e None admin] PATH_INFO: `/v3/users/fa267c0ecba849639a0f3f88fc3d1ac4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:06.006583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e8c0c-7e22-4300-9ae2-c11c52ce905e None admin] RBAC: Authorizing `identity:get_user(user_id=fa267c0ecba849639a0f3f88fc3d1ac4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:06.008020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e8c0c-7e22-4300-9ae2-c11c52ce905e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:06.009670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 571/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:05 2022] GET /identity/v3/users/fa267c0ecba849639a0f3f88fc3d1ac4 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:28:06.015745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dbaa9-8aea-47bf-adb9-59ac0d80e8fb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:06.124680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dbaa9-8aea-47bf-adb9-59ac0d80e8fb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:06.160785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6e3e8-bda8-4b86-be61-01e75b769004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:06.161669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6e3e8-bda8-4b86-be61-01e75b769004 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:06.161951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6e3e8-bda8-4b86-be61-01e75b769004 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:06.162221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6e3e8-bda8-4b86-be61-01e75b769004 None admin] PATH_INFO: `/v3/projects/e007cae75b544f669837b2bee57a4ff6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:06.163439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6e3e8-bda8-4b86-be61-01e75b769004 None admin] RBAC: Authorizing `identity:get_project(project_id=e007cae75b544f669837b2bee57a4ff6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:06.164870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6e3e8-bda8-4b86-be61-01e75b769004 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:06.166619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 551/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:06 2022] GET /identity/v3/projects/e007cae75b544f669837b2bee57a4ff6 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:06.176459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e8c0c-7e22-4300-9ae2-c11c52ce905e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:06.291136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e8c0c-7e22-4300-9ae2-c11c52ce905e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:06.325668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7eeb71-8000-4ed6-ae53-a49cbd1ee38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:06.326548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eeb71-8000-4ed6-ae53-a49cbd1ee38a None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:06.326822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eeb71-8000-4ed6-ae53-a49cbd1ee38a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:06.327094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eeb71-8000-4ed6-ae53-a49cbd1ee38a None admin] PATH_INFO: `/v3/projects/e007cae75b544f669837b2bee57a4ff6/users/fa267c0ecba849639a0f3f88fc3d1ac4/roles/b2a32fa865d44fe48cd439137f78a12f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:06.329738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7eeb71-8000-4ed6-ae53-a49cbd1ee38a None admin] RBAC: Authorizing `identity:create_grant(project_id=e007cae75b544f669837b2bee57a4ff6, user_id=fa267c0ecba849639a0f3f88fc3d1ac4, role_id=b2a32fa865d44fe48cd439137f78a12f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:06.331181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7eeb71-8000-4ed6-ae53-a49cbd1ee38a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:06.346740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 572/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:28:06 2022] PUT /identity/v3/projects/e007cae75b544f669837b2bee57a4ff6/users/fa267c0ecba849639a0f3f88fc3d1ac4/roles/b2a32fa865d44fe48cd439137f78a12f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:28:08.548659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de141c-432b-457f-8f72-b9d84c02dad8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:08.549206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de141c-432b-457f-8f72-b9d84c02dad8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:08.549206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de141c-432b-457f-8f72-b9d84c02dad8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:08.551784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 552/1124] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:08.559315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40b77-fb8a-41b8-a5de-020608e8d07c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:08.559760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40b77-fb8a-41b8-a5de-020608e8d07c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:08.559858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40b77-fb8a-41b8-a5de-020608e8d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:08.577886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ce40b77-fb8a-41b8-a5de-020608e8d07c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:08.579056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ce40b77-fb8a-41b8-a5de-020608e8d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:08.645147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 573/1125] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:28:08.677300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de141c-432b-457f-8f72-b9d84c02dad8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:08.784185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de141c-432b-457f-8f72-b9d84c02dad8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:08.818318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329acd4f-74aa-4146-a843-aed8996f063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:08.819098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329acd4f-74aa-4146-a843-aed8996f063f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:08.819375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329acd4f-74aa-4146-a843-aed8996f063f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:08.819648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329acd4f-74aa-4146-a843-aed8996f063f None admin] PATH_INFO: `/v3/roles/b2a32fa865d44fe48cd439137f78a12f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:08.821160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329acd4f-74aa-4146-a843-aed8996f063f None admin] RBAC: Authorizing `identity:get_role(role_id=b2a32fa865d44fe48cd439137f78a12f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:08.822637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329acd4f-74aa-4146-a843-aed8996f063f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:08.824010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 553/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:08 2022] GET /identity/v3/roles/b2a32fa865d44fe48cd439137f78a12f => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:08.830136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce40b77-fb8a-41b8-a5de-020608e8d07c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:08.934525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce40b77-fb8a-41b8-a5de-020608e8d07c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:08.969659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981a884-7de5-4ec7-8665-d6aa5bf86c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:08.970522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981a884-7de5-4ec7-8665-d6aa5bf86c91 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:08.970799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981a884-7de5-4ec7-8665-d6aa5bf86c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:08.971066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981a884-7de5-4ec7-8665-d6aa5bf86c91 None admin] PATH_INFO: `/v3/users/fa267c0ecba849639a0f3f88fc3d1ac4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:08.972279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981a884-7de5-4ec7-8665-d6aa5bf86c91 None admin] RBAC: Authorizing `identity:get_user(user_id=fa267c0ecba849639a0f3f88fc3d1ac4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:08.973750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981a884-7de5-4ec7-8665-d6aa5bf86c91 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:08.975361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 574/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:08 2022] GET /identity/v3/users/fa267c0ecba849639a0f3f88fc3d1ac4 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:08.981400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329acd4f-74aa-4146-a843-aed8996f063f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:09.083961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329acd4f-74aa-4146-a843-aed8996f063f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:09.118117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4b66-38c3-46a1-8dec-f460d398ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:09.118755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4b66-38c3-46a1-8dec-f460d398ad97 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:09.119066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4b66-38c3-46a1-8dec-f460d398ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:09.119356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4b66-38c3-46a1-8dec-f460d398ad97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:09.188065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4b66-38c3-46a1-8dec-f460d398ad97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:09.189491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4b66-38c3-46a1-8dec-f460d398ad97 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:09.283559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 554/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:28:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:28:09.289776 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981a884-7de5-4ec7-8665-d6aa5bf86c91 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:09.401974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981a884-7de5-4ec7-8665-d6aa5bf86c91 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:09.436446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee60af7-3027-4b30-8db7-67cee4a922b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:09.437296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee60af7-3027-4b30-8db7-67cee4a922b1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:09.437593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee60af7-3027-4b30-8db7-67cee4a922b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:09.437872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee60af7-3027-4b30-8db7-67cee4a922b1 None admin] PATH_INFO: `/v3/projects/e007cae75b544f669837b2bee57a4ff6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:09.439152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee60af7-3027-4b30-8db7-67cee4a922b1 None admin] RBAC: Authorizing `identity:get_project(project_id=e007cae75b544f669837b2bee57a4ff6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:09.440605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee60af7-3027-4b30-8db7-67cee4a922b1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:09.442326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 575/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:09 2022] GET /identity/v3/projects/e007cae75b544f669837b2bee57a4ff6 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:09.451319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4b66-38c3-46a1-8dec-f460d398ad97 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:09.555356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4b66-38c3-46a1-8dec-f460d398ad97 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:09.589974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e742-0226-4657-adfa-2589707e8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:09.590611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e742-0226-4657-adfa-2589707e8bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:09.590885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e742-0226-4657-adfa-2589707e8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:09.591150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e742-0226-4657-adfa-2589707e8bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:09.591967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e742-0226-4657-adfa-2589707e8bc9 None admin] RBAC: Adding query filter params (role.id=b2a32fa865d44fe48cd439137f78a12f, scope.project.id=e007cae75b544f669837b2bee57a4ff6, user.id=fa267c0ecba849639a0f3f88fc3d1ac4) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:09.592274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e742-0226-4657-adfa-2589707e8bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:09.593710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e742-0226-4657-adfa-2589707e8bc9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:09.599471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 555/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:28:09 2022] GET /identity/v3/role_assignments?user.id=fa267c0ecba849639a0f3f88fc3d1ac4&scope.project.id=e007cae75b544f669837b2bee57a4ff6&role.id=b2a32fa865d44fe48cd439137f78a12f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:11.785246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856cb7d-96c3-47b9-ba20-4d866103d066 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:11.785845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856cb7d-96c3-47b9-ba20-4d866103d066 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:11.785845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856cb7d-96c3-47b9-ba20-4d866103d066 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:11.787191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 576/1131] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:11.794312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4fb4a-899d-4513-a431-7dc68761e4bc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:11.795064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4fb4a-899d-4513-a431-7dc68761e4bc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:11.795451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4fb4a-899d-4513-a431-7dc68761e4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:11.823327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-60d4fb4a-899d-4513-a431-7dc68761e4bc None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:11.824491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-60d4fb4a-899d-4513-a431-7dc68761e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:11.887120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 556/1132] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:11.911283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856cb7d-96c3-47b9-ba20-4d866103d066 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:12.022473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856cb7d-96c3-47b9-ba20-4d866103d066 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:12.057785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab00b5-9f4d-421e-8494-6771a19437e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:12.058530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab00b5-9f4d-421e-8494-6771a19437e0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:12.058808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab00b5-9f4d-421e-8494-6771a19437e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:12.059079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab00b5-9f4d-421e-8494-6771a19437e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:12.060363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab00b5-9f4d-421e-8494-6771a19437e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:12.061921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab00b5-9f4d-421e-8494-6771a19437e0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:12.063689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 577/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:12.070475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4fb4a-899d-4513-a431-7dc68761e4bc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:12.185207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4fb4a-899d-4513-a431-7dc68761e4bc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:12.222720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b18a84-1412-4778-8529-5e1678d7e08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:12.223420 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b18a84-1412-4778-8529-5e1678d7e08a None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:12.223706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b18a84-1412-4778-8529-5e1678d7e08a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:12.223976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b18a84-1412-4778-8529-5e1678d7e08a None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:12.224695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b18a84-1412-4778-8529-5e1678d7e08a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:12.226216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b18a84-1412-4778-8529-5e1678d7e08a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:12.260732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 557/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:28:12 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:28:14.501765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784096-1beb-4919-93dd-9fb446547c71 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:14.502302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784096-1beb-4919-93dd-9fb446547c71 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:14.502302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784096-1beb-4919-93dd-9fb446547c71 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:14.503696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 578/1135] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:14.510200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bd62b-e471-4b9d-8eef-b91f90fdbab0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:14.510883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bd62b-e471-4b9d-8eef-b91f90fdbab0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:14.511159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bd62b-e471-4b9d-8eef-b91f90fdbab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:14.534218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c28bd62b-e471-4b9d-8eef-b91f90fdbab0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:14.535398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c28bd62b-e471-4b9d-8eef-b91f90fdbab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:14.609449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 558/1136] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:14.638164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16784096-1beb-4919-93dd-9fb446547c71 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:14.747271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16784096-1beb-4919-93dd-9fb446547c71 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:14.781161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada6f68-bf41-40e1-8d13-63ffd920e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:14.781914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada6f68-bf41-40e1-8d13-63ffd920e730 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:14.782170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada6f68-bf41-40e1-8d13-63ffd920e730 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:14.782440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada6f68-bf41-40e1-8d13-63ffd920e730 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:14.783652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada6f68-bf41-40e1-8d13-63ffd920e730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:14.785086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada6f68-bf41-40e1-8d13-63ffd920e730 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:14.786760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 579/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:28:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:14.793935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bd62b-e471-4b9d-8eef-b91f90fdbab0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:14.902981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bd62b-e471-4b9d-8eef-b91f90fdbab0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:14.936657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df56449-122c-4473-8931-0c3534c9149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:14.937316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56449-122c-4473-8931-0c3534c9149e None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:14.937592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56449-122c-4473-8931-0c3534c9149e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:14.937879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56449-122c-4473-8931-0c3534c9149e None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:14.938573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df56449-122c-4473-8931-0c3534c9149e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:14.940007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df56449-122c-4473-8931-0c3534c9149e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:14.966478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 559/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:28:14 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:28:17.205253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569a24e-7b69-49d0-87b6-5e9c39f2902e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:17.205917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569a24e-7b69-49d0-87b6-5e9c39f2902e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:17.205917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569a24e-7b69-49d0-87b6-5e9c39f2902e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:17.207195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 580/1139] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:17.213710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee9af4-5572-4198-8cff-eadabd57872e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:17.214456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee9af4-5572-4198-8cff-eadabd57872e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:17.214624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee9af4-5572-4198-8cff-eadabd57872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:17.241385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-73ee9af4-5572-4198-8cff-eadabd57872e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:17.242836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-73ee9af4-5572-4198-8cff-eadabd57872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:17.320056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 560/1140] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:17.350613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569a24e-7b69-49d0-87b6-5e9c39f2902e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:17.453219 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569a24e-7b69-49d0-87b6-5e9c39f2902e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:17.486450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d572f-ad12-42b8-80ba-dadd45741a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:17.487155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d572f-ad12-42b8-80ba-dadd45741a8d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:17.487431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d572f-ad12-42b8-80ba-dadd45741a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:17.487700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d572f-ad12-42b8-80ba-dadd45741a8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:17.497519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d572f-ad12-42b8-80ba-dadd45741a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9b4d572f-ad12-42b8-80ba-dadd45741a8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:28:17.504993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:28:17.506222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:28:17.507525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 581/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:28:17.514242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee9af4-5572-4198-8cff-eadabd57872e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:17.634492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee9af4-5572-4198-8cff-eadabd57872e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:17.669059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:17.669746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:17.670024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:17.670309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:17.671053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:17.671354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:17.672722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:17.684785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 561/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:17.690931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d572f-ad12-42b8-80ba-dadd45741a8d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:17.784992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d572f-ad12-42b8-80ba-dadd45741a8d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:17.824285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f75867-659f-41cd-b8f0-70d47cc3b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:17.825158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f75867-659f-41cd-b8f0-70d47cc3b10c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:17.825439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f75867-659f-41cd-b8f0-70d47cc3b10c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:17.825744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f75867-659f-41cd-b8f0-70d47cc3b10c None admin] PATH_INFO: `/v3/users/3489198fa1c34f7fbeebb3dc0a117288` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:17.840319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f75867-659f-41cd-b8f0-70d47cc3b10c None admin] RBAC: Authorizing `identity:get_user(user_id=3489198fa1c34f7fbeebb3dc0a117288)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:17.841838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f75867-659f-41cd-b8f0-70d47cc3b10c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:17.843475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 582/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:17 2022] GET /identity/v3/users/3489198fa1c34f7fbeebb3dc0a117288 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:17.849911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:17.951379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d94e4b-9425-4122-8c96-64408f82fc78 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:17.988200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7542436-4111-49d0-b727-c2c7888c22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:17.988834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542436-4111-49d0-b727-c2c7888c22a7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:17.989108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542436-4111-49d0-b727-c2c7888c22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:17.989379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542436-4111-49d0-b727-c2c7888c22a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:18.055638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7542436-4111-49d0-b727-c2c7888c22a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:18.057068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7542436-4111-49d0-b727-c2c7888c22a7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:18.155452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 562/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:28:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:28:18.161587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f75867-659f-41cd-b8f0-70d47cc3b10c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:18.273339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f75867-659f-41cd-b8f0-70d47cc3b10c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:18.308104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfc498-c46f-4b49-9eb7-959533155be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:18.308868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfc498-c46f-4b49-9eb7-959533155be3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:18.309146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfc498-c46f-4b49-9eb7-959533155be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:18.309417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfc498-c46f-4b49-9eb7-959533155be3 None admin] PATH_INFO: `/v3/projects/17b7c72c761343a2987e81662a77086a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:18.310730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfc498-c46f-4b49-9eb7-959533155be3 None admin] RBAC: Authorizing `identity:get_project(project_id=17b7c72c761343a2987e81662a77086a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:18.312165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfc498-c46f-4b49-9eb7-959533155be3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:18.313889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 583/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:18 2022] GET /identity/v3/projects/17b7c72c761343a2987e81662a77086a => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:18.323832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7542436-4111-49d0-b727-c2c7888c22a7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:18.428598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7542436-4111-49d0-b727-c2c7888c22a7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:18.462692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4efcce-a5d9-445f-8cd7-0a0b5abf7f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:18.463338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4efcce-a5d9-445f-8cd7-0a0b5abf7f8d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:18.463615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4efcce-a5d9-445f-8cd7-0a0b5abf7f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:18.463887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4efcce-a5d9-445f-8cd7-0a0b5abf7f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:18.464715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4efcce-a5d9-445f-8cd7-0a0b5abf7f8d None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=17b7c72c761343a2987e81662a77086a, user.id=3489198fa1c34f7fbeebb3dc0a117288) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:18.465034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4efcce-a5d9-445f-8cd7-0a0b5abf7f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:18.466476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4efcce-a5d9-445f-8cd7-0a0b5abf7f8d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:18.471971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 563/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:28:18 2022] GET /identity/v3/role_assignments?user.id=3489198fa1c34f7fbeebb3dc0a117288&scope.project.id=17b7c72c761343a2987e81662a77086a&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:20.672977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1c16-ba7b-48ec-b843-876724911c59 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:20.673872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1c16-ba7b-48ec-b843-876724911c59 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:20.673872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1c16-ba7b-48ec-b843-876724911c59 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:20.676379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 584/1147] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:20.685050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cac3d-3d8a-457b-bda3-57e8c6e2e8fe None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:20.685453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cac3d-3d8a-457b-bda3-57e8c6e2e8fe None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:20.685683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cac3d-3d8a-457b-bda3-57e8c6e2e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:20.707357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6a0cac3d-3d8a-457b-bda3-57e8c6e2e8fe None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:20.708546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6a0cac3d-3d8a-457b-bda3-57e8c6e2e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:20.776638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 564/1148] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:20.800213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f1c16-ba7b-48ec-b843-876724911c59 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:20.912915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f1c16-ba7b-48ec-b843-876724911c59 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:20.955949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04f1d2-d909-43fe-af7f-be0d2d171f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:20.956656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04f1d2-d909-43fe-af7f-be0d2d171f8f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:20.956932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04f1d2-d909-43fe-af7f-be0d2d171f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:20.957202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04f1d2-d909-43fe-af7f-be0d2d171f8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:20.967624 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04f1d2-d909-43fe-af7f-be0d2d171f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-da04f1d2-d909-43fe-af7f-be0d2d171f8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:28:20.975199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:28:20.976303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:28:20.977575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 585/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:28:20.983183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cac3d-3d8a-457b-bda3-57e8c6e2e8fe None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:21.087682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cac3d-3d8a-457b-bda3-57e8c6e2e8fe None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:21.121460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:21.122142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:21.122422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:21.122697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:21.123434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:21.123736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:21.125102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:21.133162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 565/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:28:21.142100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04f1d2-d909-43fe-af7f-be0d2d171f8f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:21.245266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04f1d2-d909-43fe-af7f-be0d2d171f8f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:21.280410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785e2f-ad64-47cf-8099-506bde108da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:21.281273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785e2f-ad64-47cf-8099-506bde108da2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:21.281571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785e2f-ad64-47cf-8099-506bde108da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:21.281860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785e2f-ad64-47cf-8099-506bde108da2 None admin] PATH_INFO: `/v3/users/3489198fa1c34f7fbeebb3dc0a117288` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:21.283089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57785e2f-ad64-47cf-8099-506bde108da2 None admin] RBAC: Authorizing `identity:get_user(user_id=3489198fa1c34f7fbeebb3dc0a117288)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:21.284547 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57785e2f-ad64-47cf-8099-506bde108da2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:21.286880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 586/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:21 2022] GET /identity/v3/users/3489198fa1c34f7fbeebb3dc0a117288 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:28:21.294763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:21.402781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0568c2a-cea1-4957-9461-35f77fd7824c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:21.449424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e02dc1-b673-427c-ab9b-b9b12ae4ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:21.450333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e02dc1-b673-427c-ab9b-b9b12ae4ce22 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:21.450612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e02dc1-b673-427c-ab9b-b9b12ae4ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:21.450891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e02dc1-b673-427c-ab9b-b9b12ae4ce22 None admin] PATH_INFO: `/v3/projects/17b7c72c761343a2987e81662a77086a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:21.452197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e02dc1-b673-427c-ab9b-b9b12ae4ce22 None admin] RBAC: Authorizing `identity:get_project(project_id=17b7c72c761343a2987e81662a77086a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:21.453678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e02dc1-b673-427c-ab9b-b9b12ae4ce22 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:21.455408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 566/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:21 2022] GET /identity/v3/projects/17b7c72c761343a2987e81662a77086a => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:21.465213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785e2f-ad64-47cf-8099-506bde108da2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:21.578988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57785e2f-ad64-47cf-8099-506bde108da2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:21.624200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c627c-9d39-40e1-a81c-4e55437c91d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:21.625085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c627c-9d39-40e1-a81c-4e55437c91d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:21.625366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c627c-9d39-40e1-a81c-4e55437c91d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:21.625674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c627c-9d39-40e1-a81c-4e55437c91d1 None admin] PATH_INFO: `/v3/projects/17b7c72c761343a2987e81662a77086a/users/3489198fa1c34f7fbeebb3dc0a117288/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:21.627898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c627c-9d39-40e1-a81c-4e55437c91d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=17b7c72c761343a2987e81662a77086a, user_id=3489198fa1c34f7fbeebb3dc0a117288, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:21.629334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c627c-9d39-40e1-a81c-4e55437c91d1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:21.643778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 587/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:28:21 2022] PUT /identity/v3/projects/17b7c72c761343a2987e81662a77086a/users/3489198fa1c34f7fbeebb3dc0a117288/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:28:23.816244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27285-2d8b-4385-ac5f-d1e2c4e5c10e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:23.816805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27285-2d8b-4385-ac5f-d1e2c4e5c10e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:23.816805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27285-2d8b-4385-ac5f-d1e2c4e5c10e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:23.818203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 567/1154] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:23.824699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493170f-3942-42d0-9403-97c1dafca1c1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:23.825422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493170f-3942-42d0-9403-97c1dafca1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:23.825643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493170f-3942-42d0-9403-97c1dafca1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:23.845200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5493170f-3942-42d0-9403-97c1dafca1c1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:23.846391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5493170f-3942-42d0-9403-97c1dafca1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:23.912861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 588/1155] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:23.944687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27285-2d8b-4385-ac5f-d1e2c4e5c10e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:24.059198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27285-2d8b-4385-ac5f-d1e2c4e5c10e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:24.092098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dff61-6c91-4204-a586-34ec5c35dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:24.092809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dff61-6c91-4204-a586-34ec5c35dec6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:24.093084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dff61-6c91-4204-a586-34ec5c35dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:24.093353 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dff61-6c91-4204-a586-34ec5c35dec6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:24.103770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dff61-6c91-4204-a586-34ec5c35dec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-814dff61-6c91-4204-a586-34ec5c35dec6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:28:24.111295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:28:24.112372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:28:24.113378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 568/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:28:24.119508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493170f-3942-42d0-9403-97c1dafca1c1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:24.229155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493170f-3942-42d0-9403-97c1dafca1c1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:24.263827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:24.264483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:24.264768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:24.265035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:24.265807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:24.266113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:24.267474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:24.275516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 589/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:24.281577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dff61-6c91-4204-a586-34ec5c35dec6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:24.383241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dff61-6c91-4204-a586-34ec5c35dec6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:24.416647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73176c6a-ab85-4cdd-8eb5-6885422f5a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:24.417500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73176c6a-ab85-4cdd-8eb5-6885422f5a25 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:24.417808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73176c6a-ab85-4cdd-8eb5-6885422f5a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:24.418077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73176c6a-ab85-4cdd-8eb5-6885422f5a25 None admin] PATH_INFO: `/v3/users/3489198fa1c34f7fbeebb3dc0a117288` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:24.419284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73176c6a-ab85-4cdd-8eb5-6885422f5a25 None admin] RBAC: Authorizing `identity:get_user(user_id=3489198fa1c34f7fbeebb3dc0a117288)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:24.420718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73176c6a-ab85-4cdd-8eb5-6885422f5a25 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:24.422374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 569/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:24 2022] GET /identity/v3/users/3489198fa1c34f7fbeebb3dc0a117288 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:28:24.429312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:24.534532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c1302-fe85-4fa7-b882-6fbef877ee45 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:24.567423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cf3e1-6436-4ce9-8712-0fc699d576bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:24.568045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cf3e1-6436-4ce9-8712-0fc699d576bf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:24.568320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cf3e1-6436-4ce9-8712-0fc699d576bf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:24.568588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cf3e1-6436-4ce9-8712-0fc699d576bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:24.633365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cf3e1-6436-4ce9-8712-0fc699d576bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:24.634865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cf3e1-6436-4ce9-8712-0fc699d576bf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:24.731003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 590/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:28:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:28:24.737046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73176c6a-ab85-4cdd-8eb5-6885422f5a25 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:24.832936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73176c6a-ab85-4cdd-8eb5-6885422f5a25 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:24.865862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce86f-c30e-4d5e-858b-0cadab2718c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:24.866690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce86f-c30e-4d5e-858b-0cadab2718c0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:24.866967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce86f-c30e-4d5e-858b-0cadab2718c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:24.867236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce86f-c30e-4d5e-858b-0cadab2718c0 None admin] PATH_INFO: `/v3/projects/17b7c72c761343a2987e81662a77086a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:24.868470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce86f-c30e-4d5e-858b-0cadab2718c0 None admin] RBAC: Authorizing `identity:get_project(project_id=17b7c72c761343a2987e81662a77086a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:24.869914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce86f-c30e-4d5e-858b-0cadab2718c0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:24.871569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 570/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:24 2022] GET /identity/v3/projects/17b7c72c761343a2987e81662a77086a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:28:24.877760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cf3e1-6436-4ce9-8712-0fc699d576bf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:24.988002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cf3e1-6436-4ce9-8712-0fc699d576bf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:25.022703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03d9d-a26d-4c2b-8c15-1c3b2b6c9596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:25.023348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d9d-a26d-4c2b-8c15-1c3b2b6c9596 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:25.023628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d9d-a26d-4c2b-8c15-1c3b2b6c9596 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:25.023902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d9d-a26d-4c2b-8c15-1c3b2b6c9596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:25.024806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c03d9d-a26d-4c2b-8c15-1c3b2b6c9596 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=17b7c72c761343a2987e81662a77086a, user.id=3489198fa1c34f7fbeebb3dc0a117288) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:25.025114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c03d9d-a26d-4c2b-8c15-1c3b2b6c9596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:25.026588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c03d9d-a26d-4c2b-8c15-1c3b2b6c9596 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:25.032466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 591/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:28:24 2022] GET /identity/v3/role_assignments?user.id=3489198fa1c34f7fbeebb3dc0a117288&scope.project.id=17b7c72c761343a2987e81662a77086a&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:27.238751 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959175c-f901-4a82-88c8-2c1fb70c8e01 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:27.239467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959175c-f901-4a82-88c8-2c1fb70c8e01 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:27.239628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959175c-f901-4a82-88c8-2c1fb70c8e01 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:27.241869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 571/1162] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:27.248139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd7c0-3163-4fda-be7d-2f6657ab2432 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:27.248598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd7c0-3163-4fda-be7d-2f6657ab2432 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:27.248691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd7c0-3163-4fda-be7d-2f6657ab2432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:27.266945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-636bd7c0-3163-4fda-be7d-2f6657ab2432 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:27.268112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-636bd7c0-3163-4fda-be7d-2f6657ab2432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:27.334919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 592/1163] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:28:27.370963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959175c-f901-4a82-88c8-2c1fb70c8e01 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:27.492590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959175c-f901-4a82-88c8-2c1fb70c8e01 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:27.527920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb8803-bf19-4941-a7d4-af214df083b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:27.528556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8803-bf19-4941-a7d4-af214df083b5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:27.528836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8803-bf19-4941-a7d4-af214df083b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:27.529112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8803-bf19-4941-a7d4-af214df083b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:27.594844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb8803-bf19-4941-a7d4-af214df083b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:27.596283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb8803-bf19-4941-a7d4-af214df083b5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:27.693588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 572/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:28:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:28:27.700628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bd7c0-3163-4fda-be7d-2f6657ab2432 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:27.822668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bd7c0-3163-4fda-be7d-2f6657ab2432 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:27.856550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0b45f-3ba5-4f50-829d-1045989db035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:27.857340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0b45f-3ba5-4f50-829d-1045989db035 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:27.857629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0b45f-3ba5-4f50-829d-1045989db035 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:27.857927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0b45f-3ba5-4f50-829d-1045989db035 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:27.864446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0b45f-3ba5-4f50-829d-1045989db035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:27.865916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0b45f-3ba5-4f50-829d-1045989db035 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0ba0b45f-3ba5-4f50-829d-1045989db035 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:28:27.880117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:28:27.881283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:28:27.882447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 593/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:28:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:28:27.887623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb8803-bf19-4941-a7d4-af214df083b5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:27.984022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb8803-bf19-4941-a7d4-af214df083b5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:28.016973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5d701-0f86-4711-b544-8fc8a78666e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:28.017619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d701-0f86-4711-b544-8fc8a78666e3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:28.017919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d701-0f86-4711-b544-8fc8a78666e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:28.018182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d701-0f86-4711-b544-8fc8a78666e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:28.018894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5d701-0f86-4711-b544-8fc8a78666e3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:28.019189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5d701-0f86-4711-b544-8fc8a78666e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:28.020546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5d701-0f86-4711-b544-8fc8a78666e3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:28.027636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 573/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Mon May 16 17:28:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:30.213484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3624d27-4eeb-44e9-a8a0-06460648e2d5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:30.214262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3624d27-4eeb-44e9-a8a0-06460648e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:30.214433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3624d27-4eeb-44e9-a8a0-06460648e2d5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:30.216565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 594/1167] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:30.222788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2fc60-bf2e-40aa-b1ef-3993e09c2a35 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:30.223486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2fc60-bf2e-40aa-b1ef-3993e09c2a35 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:30.223630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2fc60-bf2e-40aa-b1ef-3993e09c2a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:30.247897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bff2fc60-bf2e-40aa-b1ef-3993e09c2a35 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:30.249084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bff2fc60-bf2e-40aa-b1ef-3993e09c2a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:30.324099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 574/1168] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:30.352522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3624d27-4eeb-44e9-a8a0-06460648e2d5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:30.463043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3624d27-4eeb-44e9-a8a0-06460648e2d5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:30.496105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf16bed-7ea1-41de-b866-69dcbeb4962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:30.496745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16bed-7ea1-41de-b866-69dcbeb4962c None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:30.497017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16bed-7ea1-41de-b866-69dcbeb4962c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:30.497282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16bed-7ea1-41de-b866-69dcbeb4962c None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:30.498048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf16bed-7ea1-41de-b866-69dcbeb4962c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:30.499412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf16bed-7ea1-41de-b866-69dcbeb4962c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:30.522540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 595/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Mon May 16 17:28:30 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:28:32.754811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d3309-dbb6-4971-ad4e-0ac9ee183725 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:32.755635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d3309-dbb6-4971-ad4e-0ac9ee183725 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:32.755635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d3309-dbb6-4971-ad4e-0ac9ee183725 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:32.757843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 575/1170] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:32.764160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57c9d-0c07-48fe-ad58-69532b477870 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:32.764594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57c9d-0c07-48fe-ad58-69532b477870 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:32.764726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57c9d-0c07-48fe-ad58-69532b477870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:32.791898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b1c57c9d-0c07-48fe-ad58-69532b477870 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:32.793097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b1c57c9d-0c07-48fe-ad58-69532b477870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:32.863041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 596/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:32.894226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d3309-dbb6-4971-ad4e-0ac9ee183725 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:33.002381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d3309-dbb6-4971-ad4e-0ac9ee183725 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:33.038199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e60805-ca18-42b3-adbe-e383c119ac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:33.038975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60805-ca18-42b3-adbe-e383c119ac90 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:33.039251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60805-ca18-42b3-adbe-e383c119ac90 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:33.039517 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60805-ca18-42b3-adbe-e383c119ac90 None admin] PATH_INFO: `/v3/domains/08416ca060b1426f850468d64108dc15` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:33.051094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e60805-ca18-42b3-adbe-e383c119ac90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=08416ca060b1426f850468d64108dc15)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:33.052535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e60805-ca18-42b3-adbe-e383c119ac90 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:33.054199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 576/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Mon May 16 17:28:32 2022] GET /identity/v3/domains/08416ca060b1426f850468d64108dc15 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:33.063012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c57c9d-0c07-48fe-ad58-69532b477870 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:33.168232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c57c9d-0c07-48fe-ad58-69532b477870 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:33.204557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca180bb-f226-4700-b63f-401596bc2cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:33.205205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca180bb-f226-4700-b63f-401596bc2cfa None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:33.205492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca180bb-f226-4700-b63f-401596bc2cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:33.205795 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca180bb-f226-4700-b63f-401596bc2cfa None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:33.206512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca180bb-f226-4700-b63f-401596bc2cfa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:33.207954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca180bb-f226-4700-b63f-401596bc2cfa None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:33.238538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 597/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:28:33 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:28:35.444009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9065b-90e5-484f-afa4-81fadf92cce4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:35.444880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9065b-90e5-484f-afa4-81fadf92cce4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:35.444880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9065b-90e5-484f-afa4-81fadf92cce4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:35.447166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 577/1174] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:35.453704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3991b-5225-4f85-8529-37902b514af5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:35.454409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3991b-5225-4f85-8529-37902b514af5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:35.454563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3991b-5225-4f85-8529-37902b514af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:35.474976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-86d3991b-5225-4f85-8529-37902b514af5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:35.476070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-86d3991b-5225-4f85-8529-37902b514af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:35.543518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 598/1175] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:35.573241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9065b-90e5-484f-afa4-81fadf92cce4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:35.684919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9065b-90e5-484f-afa4-81fadf92cce4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:35.719835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728fa2d-7a61-4ccf-95b6-ad0902108b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:35.720682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fa2d-7a61-4ccf-95b6-ad0902108b13 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:35.720959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fa2d-7a61-4ccf-95b6-ad0902108b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:35.721230 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fa2d-7a61-4ccf-95b6-ad0902108b13 None admin] PATH_INFO: `/v3/domains/08416ca060b1426f850468d64108dc15` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:35.722559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728fa2d-7a61-4ccf-95b6-ad0902108b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=08416ca060b1426f850468d64108dc15)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:35.724003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728fa2d-7a61-4ccf-95b6-ad0902108b13 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:35.725742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 578/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Mon May 16 17:28:35 2022] GET /identity/v3/domains/08416ca060b1426f850468d64108dc15 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:35.732082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3991b-5225-4f85-8529-37902b514af5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:35.841526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3991b-5225-4f85-8529-37902b514af5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:35.875094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb765d-a36b-48c4-b8d7-42fe9a0c9ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:35.875744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb765d-a36b-48c4-b8d7-42fe9a0c9ce5 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:35.876018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb765d-a36b-48c4-b8d7-42fe9a0c9ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:35.876287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb765d-a36b-48c4-b8d7-42fe9a0c9ce5 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:35.876983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb765d-a36b-48c4-b8d7-42fe9a0c9ce5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:35.878431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb765d-a36b-48c4-b8d7-42fe9a0c9ce5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:35.900204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 599/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:28:35 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:28:38.123698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce485-beb4-4bd4-ab5a-23b43a89617a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:38.124570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce485-beb4-4bd4-ab5a-23b43a89617a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:38.124570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce485-beb4-4bd4-ab5a-23b43a89617a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:38.126848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 579/1178] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:38.132216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43cd6-233c-4227-a11a-2fc564dfa77a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:38.132633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43cd6-233c-4227-a11a-2fc564dfa77a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:38.132736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43cd6-233c-4227-a11a-2fc564dfa77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:38.150412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d4a43cd6-233c-4227-a11a-2fc564dfa77a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:38.152243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d4a43cd6-233c-4227-a11a-2fc564dfa77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:38.235116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 600/1179] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:38.258674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ce485-beb4-4bd4-ab5a-23b43a89617a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:38.372886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ce485-beb4-4bd4-ab5a-23b43a89617a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:38.409610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4656-c4f8-43ce-8913-5a2fc0f0d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:38.410327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4656-c4f8-43ce-8913-5a2fc0f0d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:38.410608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4656-c4f8-43ce-8913-5a2fc0f0d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:38.410875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4656-c4f8-43ce-8913-5a2fc0f0d0f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:38.421896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df4656-c4f8-43ce-8913-5a2fc0f0d0f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-00df4656-c4f8-43ce-8913-5a2fc0f0d0f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:28:38.429730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:28:38.430915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:28:38.432675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 580/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:28:38.439670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43cd6-233c-4227-a11a-2fc564dfa77a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:38.538730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43cd6-233c-4227-a11a-2fc564dfa77a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:38.575974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:38.576634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:38.576911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:38.577181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:38.577983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:38.578281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:38.579641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:38.588393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 601/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:28:38.594298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4656-c4f8-43ce-8913-5a2fc0f0d0f5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:38.700405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4656-c4f8-43ce-8913-5a2fc0f0d0f5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:38.734791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264934c1-9d14-457e-a1f9-0b8a148edbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:38.735644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264934c1-9d14-457e-a1f9-0b8a148edbcc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:38.735924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264934c1-9d14-457e-a1f9-0b8a148edbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:38.736198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264934c1-9d14-457e-a1f9-0b8a148edbcc None admin] PATH_INFO: `/v3/users/2846b933d253429ca0e7a10bcf042498` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:38.749440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264934c1-9d14-457e-a1f9-0b8a148edbcc None admin] RBAC: Authorizing `identity:get_user(user_id=2846b933d253429ca0e7a10bcf042498)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:38.750910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264934c1-9d14-457e-a1f9-0b8a148edbcc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:38.752516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 581/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:38 2022] GET /identity/v3/users/2846b933d253429ca0e7a10bcf042498 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:38.760587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:38.864566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3b20-3317-4b85-ae3f-db996b63b539 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:38.898180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab3dd2-2769-433d-af47-54325b213479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:38.898815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab3dd2-2769-433d-af47-54325b213479 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:38.899121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab3dd2-2769-433d-af47-54325b213479 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:38.899397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab3dd2-2769-433d-af47-54325b213479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:38.970994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab3dd2-2769-433d-af47-54325b213479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:38.972388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab3dd2-2769-433d-af47-54325b213479 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:39.073598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 602/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:28:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 17:28:39.082439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264934c1-9d14-457e-a1f9-0b8a148edbcc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:39.180675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264934c1-9d14-457e-a1f9-0b8a148edbcc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:39.215703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a65198-984d-444c-87a3-d96cea3511a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:39.216555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65198-984d-444c-87a3-d96cea3511a9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:39.216837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65198-984d-444c-87a3-d96cea3511a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:39.217107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a65198-984d-444c-87a3-d96cea3511a9 None admin] PATH_INFO: `/v3/projects/364285815a8b4916991a5ff5d92eac8a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:39.218471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a65198-984d-444c-87a3-d96cea3511a9 None admin] RBAC: Authorizing `identity:get_project(project_id=364285815a8b4916991a5ff5d92eac8a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:39.219906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a65198-984d-444c-87a3-d96cea3511a9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:39.221647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 582/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:39 2022] GET /identity/v3/projects/364285815a8b4916991a5ff5d92eac8a => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:28:39.227942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab3dd2-2769-433d-af47-54325b213479 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:39.325882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab3dd2-2769-433d-af47-54325b213479 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:39.359794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae922b3-bfde-46a6-b350-8c647947f63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:39.360457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae922b3-bfde-46a6-b350-8c647947f63e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:39.360705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae922b3-bfde-46a6-b350-8c647947f63e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:39.360997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae922b3-bfde-46a6-b350-8c647947f63e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:39.361836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae922b3-bfde-46a6-b350-8c647947f63e None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=364285815a8b4916991a5ff5d92eac8a, user.id=2846b933d253429ca0e7a10bcf042498) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:39.362136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae922b3-bfde-46a6-b350-8c647947f63e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:39.363556 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae922b3-bfde-46a6-b350-8c647947f63e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:39.369026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 603/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:28:39 2022] GET /identity/v3/role_assignments?user.id=2846b933d253429ca0e7a10bcf042498&scope.project.id=364285815a8b4916991a5ff5d92eac8a&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:41.536840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f4c9-0ff8-4338-8a39-42cd11cb17d4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:41.537744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f4c9-0ff8-4338-8a39-42cd11cb17d4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:41.537744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f4c9-0ff8-4338-8a39-42cd11cb17d4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:41.539955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 583/1186] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:41.545507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a16f1a-291f-4bbf-a75c-31903c6d0875 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:41.545943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a16f1a-291f-4bbf-a75c-31903c6d0875 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:41.546047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a16f1a-291f-4bbf-a75c-31903c6d0875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:41.564949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-11a16f1a-291f-4bbf-a75c-31903c6d0875 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:41.566460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-11a16f1a-291f-4bbf-a75c-31903c6d0875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:41.630769 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 604/1187] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:41.654493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864f4c9-0ff8-4338-8a39-42cd11cb17d4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:41.756052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864f4c9-0ff8-4338-8a39-42cd11cb17d4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:41.790010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a6baa-796b-4569-8335-8facfd5ed9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:41.790722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a6baa-796b-4569-8335-8facfd5ed9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:41.790997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a6baa-796b-4569-8335-8facfd5ed9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:41.791267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a6baa-796b-4569-8335-8facfd5ed9d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:41.802140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a6baa-796b-4569-8335-8facfd5ed9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-859a6baa-796b-4569-8335-8facfd5ed9d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:28:41.809906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:28:41.810997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:28:41.812162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 584/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:28:41.818110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a16f1a-291f-4bbf-a75c-31903c6d0875 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:41.915804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a16f1a-291f-4bbf-a75c-31903c6d0875 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:41.949973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:41.950602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:41.950876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:41.951142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:41.951883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:41.952182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:41.953588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:41.961525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 605/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:41.967688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a6baa-796b-4569-8335-8facfd5ed9d5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:42.071532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a6baa-796b-4569-8335-8facfd5ed9d5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:42.105041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b76ba0-e2e1-4b56-9783-a264a3ab44cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:42.105923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76ba0-e2e1-4b56-9783-a264a3ab44cf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:42.106197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76ba0-e2e1-4b56-9783-a264a3ab44cf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:42.106463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76ba0-e2e1-4b56-9783-a264a3ab44cf None admin] PATH_INFO: `/v3/users/2846b933d253429ca0e7a10bcf042498` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:42.107761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b76ba0-e2e1-4b56-9783-a264a3ab44cf None admin] RBAC: Authorizing `identity:get_user(user_id=2846b933d253429ca0e7a10bcf042498)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:42.109193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b76ba0-e2e1-4b56-9783-a264a3ab44cf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:42.110831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 585/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:41 2022] GET /identity/v3/users/2846b933d253429ca0e7a10bcf042498 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:42.117369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:42.248601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57533a-8e58-4380-a5a0-c0740376dbdb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:42.283777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba719c-046d-491a-a204-1318042b07ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:42.284629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba719c-046d-491a-a204-1318042b07ea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:42.284909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba719c-046d-491a-a204-1318042b07ea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:42.285181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba719c-046d-491a-a204-1318042b07ea None admin] PATH_INFO: `/v3/projects/364285815a8b4916991a5ff5d92eac8a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:42.286525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba719c-046d-491a-a204-1318042b07ea None admin] RBAC: Authorizing `identity:get_project(project_id=364285815a8b4916991a5ff5d92eac8a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:42.287958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba719c-046d-491a-a204-1318042b07ea None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:42.289773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 606/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:42 2022] GET /identity/v3/projects/364285815a8b4916991a5ff5d92eac8a => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:42.296075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b76ba0-e2e1-4b56-9783-a264a3ab44cf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:42.395530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b76ba0-e2e1-4b56-9783-a264a3ab44cf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:42.428725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2628c-0d31-4ee3-8d7d-61b3906216d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:42.429594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2628c-0d31-4ee3-8d7d-61b3906216d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:42.429897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2628c-0d31-4ee3-8d7d-61b3906216d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:42.430320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2628c-0d31-4ee3-8d7d-61b3906216d7 None admin] PATH_INFO: `/v3/projects/364285815a8b4916991a5ff5d92eac8a/users/2846b933d253429ca0e7a10bcf042498/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:42.432362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2628c-0d31-4ee3-8d7d-61b3906216d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=364285815a8b4916991a5ff5d92eac8a, user_id=2846b933d253429ca0e7a10bcf042498, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:42.433819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2628c-0d31-4ee3-8d7d-61b3906216d7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:42.448932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 586/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:28:42 2022] PUT /identity/v3/projects/364285815a8b4916991a5ff5d92eac8a/users/2846b933d253429ca0e7a10bcf042498/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:28:44.605507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc782-9350-41ae-81e2-293f6906092e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:44.606333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc782-9350-41ae-81e2-293f6906092e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:44.606333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc782-9350-41ae-81e2-293f6906092e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:44.608546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 607/1193] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:28:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:28:44.614162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e6f1-d913-4235-a083-4f8cbd4d83f4 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:44.614597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e6f1-d913-4235-a083-4f8cbd4d83f4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:44.614696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e6f1-d913-4235-a083-4f8cbd4d83f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:44.633863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-63a3e6f1-d913-4235-a083-4f8cbd4d83f4 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:28:44.635011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-63a3e6f1-d913-4235-a083-4f8cbd4d83f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:44.703893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 587/1194] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:28:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:28:44.728082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefc782-9350-41ae-81e2-293f6906092e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:44.844170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefc782-9350-41ae-81e2-293f6906092e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:44.877804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8d03c-b12c-48fe-8c6e-75714bd30b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:44.878509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d03c-b12c-48fe-8c6e-75714bd30b6a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:44.878783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d03c-b12c-48fe-8c6e-75714bd30b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:44.879052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d03c-b12c-48fe-8c6e-75714bd30b6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:44.890153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8d03c-b12c-48fe-8c6e-75714bd30b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7ee8d03c-b12c-48fe-8c6e-75714bd30b6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:28:44.897587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:28:44.898704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:28:44.899968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 608/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:28:44.908165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e6f1-d913-4235-a083-4f8cbd4d83f4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:45.006978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e6f1-d913-4235-a083-4f8cbd4d83f4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:45.040737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:45.041386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:45.041691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:45.041961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:45.042707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:45.043000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:45.044360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:45.052658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 588/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:45.058811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8d03c-b12c-48fe-8c6e-75714bd30b6a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:45.167955 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8d03c-b12c-48fe-8c6e-75714bd30b6a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:45.202021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7212-e952-42ee-99ef-035ceb1cc085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:45.202880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7212-e952-42ee-99ef-035ceb1cc085 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:45.203159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7212-e952-42ee-99ef-035ceb1cc085 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:45.203437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7212-e952-42ee-99ef-035ceb1cc085 None admin] PATH_INFO: `/v3/users/2846b933d253429ca0e7a10bcf042498` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:45.204658 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad7212-e952-42ee-99ef-035ceb1cc085 None admin] RBAC: Authorizing `identity:get_user(user_id=2846b933d253429ca0e7a10bcf042498)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:45.206147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad7212-e952-42ee-99ef-035ceb1cc085 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:45.207783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 609/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Mon May 16 17:28:45 2022] GET /identity/v3/users/2846b933d253429ca0e7a10bcf042498 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:45.214108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:45.312171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22df3b-f4db-4d2e-b6cc-89bfac9eeda5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:45.346146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2a823-7a29-424c-91cd-f017085e3169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:45.346788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a823-7a29-424c-91cd-f017085e3169 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:45.347062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a823-7a29-424c-91cd-f017085e3169 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:45.347336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a823-7a29-424c-91cd-f017085e3169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:45.413196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2a823-7a29-424c-91cd-f017085e3169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:45.414702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2a823-7a29-424c-91cd-f017085e3169 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:45.510374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 589/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:28:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:28:45.516728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7212-e952-42ee-99ef-035ceb1cc085 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:45.618946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7212-e952-42ee-99ef-035ceb1cc085 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:45.652697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4590e4d-857f-4cf6-85fb-acaa9f0b462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:45.653529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4590e4d-857f-4cf6-85fb-acaa9f0b462a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:45.653836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4590e4d-857f-4cf6-85fb-acaa9f0b462a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:45.654108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4590e4d-857f-4cf6-85fb-acaa9f0b462a None admin] PATH_INFO: `/v3/projects/364285815a8b4916991a5ff5d92eac8a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:45.655408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4590e4d-857f-4cf6-85fb-acaa9f0b462a None admin] RBAC: Authorizing `identity:get_project(project_id=364285815a8b4916991a5ff5d92eac8a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:45.656824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4590e4d-857f-4cf6-85fb-acaa9f0b462a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:45.658523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 610/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Mon May 16 17:28:45 2022] GET /identity/v3/projects/364285815a8b4916991a5ff5d92eac8a => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:28:45.666945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2a823-7a29-424c-91cd-f017085e3169 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:45.774090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2a823-7a29-424c-91cd-f017085e3169 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:45.812960 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f6ebd-1145-404a-822f-5d8b6b7110e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:45.813599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6ebd-1145-404a-822f-5d8b6b7110e7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:45.813915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6ebd-1145-404a-822f-5d8b6b7110e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:45.814176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6ebd-1145-404a-822f-5d8b6b7110e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:45.815006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f6ebd-1145-404a-822f-5d8b6b7110e7 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=364285815a8b4916991a5ff5d92eac8a, user.id=2846b933d253429ca0e7a10bcf042498) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:28:45.815305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f6ebd-1145-404a-822f-5d8b6b7110e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:45.816741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f6ebd-1145-404a-822f-5d8b6b7110e7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:45.822686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 590/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:28:45 2022] GET /identity/v3/role_assignments?user.id=2846b933d253429ca0e7a10bcf042498&scope.project.id=364285815a8b4916991a5ff5d92eac8a&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:46.026592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f527-a8e6-49f1-a615-a0865c96669b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:46.027200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f527-a8e6-49f1-a615-a0865c96669b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:46.027200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f527-a8e6-49f1-a615-a0865c96669b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:46.028632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 611/1201] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:29:46.036852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c84f27-9171-4b35-99c6-8540a25a4124 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:46.036852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c84f27-9171-4b35-99c6-8540a25a4124 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:46.036852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c84f27-9171-4b35-99c6-8540a25a4124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:46.054014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-52c84f27-9171-4b35-99c6-8540a25a4124 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:29:46.055465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-52c84f27-9171-4b35-99c6-8540a25a4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:29:46.129392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 591/1202] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:29:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:29:46.157076 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5f527-a8e6-49f1-a615-a0865c96669b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:46.280248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5f527-a8e6-49f1-a615-a0865c96669b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:46.319598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:46.320486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:46.320823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:46.321197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:46.332845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:46.334396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:29:46.352623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:46.354200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:46.355596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:29:46.355596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:29:46.355596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:46.355596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:29:46.355596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 612/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:46.363032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c84f27-9171-4b35-99c6-8540a25a4124 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:46.485238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c84f27-9171-4b35-99c6-8540a25a4124 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:46.523680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b091-2741-4c12-8dd0-2f84d58b659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:46.524866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b091-2741-4c12-8dd0-2f84d58b659d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:46.525047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b091-2741-4c12-8dd0-2f84d58b659d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:46.525302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b091-2741-4c12-8dd0-2f84d58b659d None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:46.526055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6b091-2741-4c12-8dd0-2f84d58b659d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:46.526406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6b091-2741-4c12-8dd0-2f84d58b659d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:46.527969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6b091-2741-4c12-8dd0-2f84d58b659d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:46.540908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 592/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:46.546901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:46.663363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d77325-b9b1-476c-8b9a-22ad8996e214 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:46.706147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec186a5c-657b-4f82-a77a-da25d316fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:46.707067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186a5c-657b-4f82-a77a-da25d316fbc3 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:46.707560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186a5c-657b-4f82-a77a-da25d316fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:46.707943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186a5c-657b-4f82-a77a-da25d316fbc3 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:46.709050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec186a5c-657b-4f82-a77a-da25d316fbc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:46.711016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec186a5c-657b-4f82-a77a-da25d316fbc3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:46.734020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 613/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Mon May 16 17:29:46 2022] POST /identity/v3/users => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:29:49.210503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964bef-b678-4089-a5a6-4e7b9a02b1ca None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:49.211023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964bef-b678-4089-a5a6-4e7b9a02b1ca None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:49.211157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964bef-b678-4089-a5a6-4e7b9a02b1ca None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:49.212446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 593/1206] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:29:49.217977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6298-2a05-40f4-8443-bf3af02bb3ca None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:49.218391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6298-2a05-40f4-8443-bf3af02bb3ca None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:49.218575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6298-2a05-40f4-8443-bf3af02bb3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:49.235647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-10fd6298-2a05-40f4-8443-bf3af02bb3ca None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:29:49.236835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-10fd6298-2a05-40f4-8443-bf3af02bb3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:29:49.305320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 614/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:29:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:29:49.328449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964bef-b678-4089-a5a6-4e7b9a02b1ca None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:49.436124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964bef-b678-4089-a5a6-4e7b9a02b1ca None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:49.473536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22215-d1dd-4c99-a399-f87cef08fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:49.474673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22215-d1dd-4c99-a399-f87cef08fab5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:49.475090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22215-d1dd-4c99-a399-f87cef08fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:49.475524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22215-d1dd-4c99-a399-f87cef08fab5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:49.488319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22215-d1dd-4c99-a399-f87cef08fab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-11b22215-d1dd-4c99-a399-f87cef08fab5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:29:49.496703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:49.498518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:49.499375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 594/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:49.504143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6298-2a05-40f4-8443-bf3af02bb3ca None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:49.610437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6298-2a05-40f4-8443-bf3af02bb3ca None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:49.645037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:49.645901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:49.646189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:49.646478 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:49.647346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:49.647678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:49.649381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:49.658373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 615/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:29:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:49.664697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22215-d1dd-4c99-a399-f87cef08fab5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:49.777842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22215-d1dd-4c99-a399-f87cef08fab5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:49.820073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:49.821065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:49.821509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:49.821851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:49.833080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:49.834783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:29:49.852948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:49.854079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:49.855025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:29:49.855025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:29:49.855025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:49.855025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:49.855025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 595/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:29:49.860460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:49.969860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5a7c-93b1-43cb-8eef-5e295166f497 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:50.008124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:50.008810 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:50.009066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:50.009337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:50.010083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:50.010410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:50.011777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:50.025258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 616/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:29:50.031304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:50.148084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3c79f-81d6-4c5d-ab80-23126ca9604e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:50.190374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:50.191470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:50.191755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:50.192029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] PATH_INFO: `/v3/users/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:50.201714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:50.203452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:29:50.220349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:50.222120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 17:29:50.223385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:50.230410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 596/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:50.231439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:50.339852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908330-3098-4af9-9a94-1ab4bcc485d1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:50.376284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:50.377689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:50.377689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:50.377936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:50.379018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:50.379296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:50.380966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:50.403614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 617/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Mon May 16 17:29:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:50.409404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:50.514694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ded5e-a087-4d36-b000-19a4515a1eae None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:50.549822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255d71-abc9-4dc7-b9df-71ef59be14ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:50.550475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255d71-abc9-4dc7-b9df-71ef59be14ea None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:50.550756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255d71-abc9-4dc7-b9df-71ef59be14ea None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:50.551050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255d71-abc9-4dc7-b9df-71ef59be14ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:50.625361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac255d71-abc9-4dc7-b9df-71ef59be14ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:50.626775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac255d71-abc9-4dc7-b9df-71ef59be14ea None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:50.739948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 597/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:29:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 17:29:50.742560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:50.849276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff260e-8625-4175-a45d-d9701cd90233 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:50.884130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:50.884819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:50.885098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:50.885409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:50.895539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:50.897330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:29:50.914560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:50.915669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:50.921404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:29:50.921404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:29:50.921404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:50.921404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:29:50.921404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 618/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:50.921763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255d71-abc9-4dc7-b9df-71ef59be14ea None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:51.028529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255d71-abc9-4dc7-b9df-71ef59be14ea None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:51.067001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:51.067694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:51.067964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:51.068237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:51.068987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:51.069260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:51.070725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:51.082478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 598/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:51.088816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:51.203017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10a50-e8d3-4d35-b3dc-123a2545dbd1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:51.248039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:51.248989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:51.249353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:51.249661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:51.257628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:51.259471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:29:51.273954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:51.275145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:29:51.281077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 619/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:51.282224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:51.396384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdad775-75fb-46f0-9f13-ce2d8a3238b3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:51.434954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91658-5143-4e57-bd71-5c0e2d02ce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:51.435714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91658-5143-4e57-bd71-5c0e2d02ce6b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:51.436043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91658-5143-4e57-bd71-5c0e2d02ce6b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:51.436310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91658-5143-4e57-bd71-5c0e2d02ce6b None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:51.437239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91658-5143-4e57-bd71-5c0e2d02ce6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:51.437578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91658-5143-4e57-bd71-5c0e2d02ce6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:51.439368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91658-5143-4e57-bd71-5c0e2d02ce6b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:51.452539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 599/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:51.458582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:51.579283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49794-8c54-4d7d-923d-6e53167a7235 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:51.618185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccf261-82e0-4bac-b562-33dd3c3c45e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:51.618844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf261-82e0-4bac-b562-33dd3c3c45e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:51.619126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf261-82e0-4bac-b562-33dd3c3c45e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:51.619406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf261-82e0-4bac-b562-33dd3c3c45e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:51.620245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccf261-82e0-4bac-b562-33dd3c3c45e9 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=02938c77178a4f14a33ff1298775687c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:51.620533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccf261-82e0-4bac-b562-33dd3c3c45e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:51.622020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccf261-82e0-4bac-b562-33dd3c3c45e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:51.633707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 620/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:29:51 2022] GET /identity/v3/role_assignments?user.id=02938c77178a4f14a33ff1298775687c&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:53.874601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d050e1-3bdf-408d-bac7-59b2339311b1 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:53.875176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d050e1-3bdf-408d-bac7-59b2339311b1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:53.875176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d050e1-3bdf-408d-bac7-59b2339311b1 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:53.876501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 600/1220] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:29:53.883924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28e4b-57e9-447a-ae92-193170749fcc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:53.883924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28e4b-57e9-447a-ae92-193170749fcc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:53.883924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28e4b-57e9-447a-ae92-193170749fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:53.901470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-67e28e4b-57e9-447a-ae92-193170749fcc None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:29:53.903069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-67e28e4b-57e9-447a-ae92-193170749fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:29:53.978294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 621/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:29:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:29:54.000852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d050e1-3bdf-408d-bac7-59b2339311b1 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:54.107979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d050e1-3bdf-408d-bac7-59b2339311b1 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:54.148000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90035219-0b3f-4dc8-87b8-bbe69f8c92db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:54.148910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035219-0b3f-4dc8-87b8-bbe69f8c92db None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:54.149253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035219-0b3f-4dc8-87b8-bbe69f8c92db None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:54.149607 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035219-0b3f-4dc8-87b8-bbe69f8c92db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:54.162042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90035219-0b3f-4dc8-87b8-bbe69f8c92db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-90035219-0b3f-4dc8-87b8-bbe69f8c92db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:29:54.170575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:54.171594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:54.172431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 601/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:29:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:54.178908 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e28e4b-57e9-447a-ae92-193170749fcc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:54.301175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e28e4b-57e9-447a-ae92-193170749fcc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:54.338917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:54.339598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:54.339872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:54.340140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:54.340929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:54.341296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:54.343598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:54.351945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 622/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:29:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:54.357802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90035219-0b3f-4dc8-87b8-bbe69f8c92db None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:54.474299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90035219-0b3f-4dc8-87b8-bbe69f8c92db None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:54.510514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:54.511378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:54.511663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:54.511932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:54.522770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:54.524266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:29:54.541269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:54.542254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:54.548815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:29:54.548815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:29:54.548815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:54.548815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:54.548815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 602/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:54.549139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:54.656671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a43a7-f2c4-4f79-a131-849f89bf0e3c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:54.692498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:54.693172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:54.693453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:54.693837 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:54.694542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:54.694903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:54.696463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:54.710208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 623/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:54.716635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:54.824315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337749a8-4b1b-43d7-8475-09769a7f84ac None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:54.859742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:54.860633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:54.861074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:54.861467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:54.870641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:54.872447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:29:54.889208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:54.891035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:54.892120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 603/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:29:54.897080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:55.007577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cbeba-9d3d-4def-b03d-33f31d281c43 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:55.045116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:55.046108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:55.046582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:55.047089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:55.048864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:55.049308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:55.051684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:55.073964 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 624/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Mon May 16 17:29:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:55.079467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:55.181076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891c60-66bd-4585-b9e8-5e5277556974 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:55.214769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:55.215596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:55.215872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:55.216141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:55.226574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:55.227981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:29:55.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:55.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:55.246848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:29:55.246848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:29:55.246848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:55.246848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:55.246848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 604/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:55.251784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:55.357536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eedaed-cff6-4900-9e6a-d883aca0c85b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:55.392911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:55.393751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:55.394039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:55.394329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:55.395131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:55.395475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:55.396993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:55.409327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 625/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:29:55.415349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:55.518538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9b67-f557-4b08-a418-3ec948d6002b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:55.555044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:55.555970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:55.556243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:55.556509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:55.564063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:55.565511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:29:55.585613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:55.586762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:55.587870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 605/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:55.593647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:55.708922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdede2c0-0e6c-4a9a-9706-fb725cb65538 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:55.744727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4836-4f6d-4076-841f-ac62cfa03e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:55.745389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4836-4f6d-4076-841f-ac62cfa03e21 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:55.745706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4836-4f6d-4076-841f-ac62cfa03e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:55.745979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4836-4f6d-4076-841f-ac62cfa03e21 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:55.746832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4836-4f6d-4076-841f-ac62cfa03e21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:55.747267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4836-4f6d-4076-841f-ac62cfa03e21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:55.749049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4836-4f6d-4076-841f-ac62cfa03e21 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:55.763345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 626/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:29:55.769866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:55.878290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93500b2b-cd96-4790-b889-706f6c30f805 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:55.915174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709b652-889d-4506-b59a-5def23ad8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:55.916137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709b652-889d-4506-b59a-5def23ad8970 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:55.916413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709b652-889d-4506-b59a-5def23ad8970 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:55.916683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709b652-889d-4506-b59a-5def23ad8970 None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/02938c77178a4f14a33ff1298775687c/roles/117a8af4218c4823b9f45e58df8c8be1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:55.932609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709b652-889d-4506-b59a-5def23ad8970 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=02938c77178a4f14a33ff1298775687c, role_id=117a8af4218c4823b9f45e58df8c8be1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:55.934254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709b652-889d-4506-b59a-5def23ad8970 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:55.949342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 606/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:29:55 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/02938c77178a4f14a33ff1298775687c/roles/117a8af4218c4823b9f45e58df8c8be1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:29:58.210298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f7b4-43b2-4046-9fb1-44ef1a49617a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:58.210736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f7b4-43b2-4046-9fb1-44ef1a49617a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:58.210838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f7b4-43b2-4046-9fb1-44ef1a49617a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:58.212395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 627/1233] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:29:58.217691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924f35-aa80-4fee-ad6c-c9693643d5f0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:58.218081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924f35-aa80-4fee-ad6c-c9693643d5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:58.218343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924f35-aa80-4fee-ad6c-c9693643d5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:58.236417 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e3924f35-aa80-4fee-ad6c-c9693643d5f0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:29:58.237667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e3924f35-aa80-4fee-ad6c-c9693643d5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:29:58.309776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 607/1234] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:29:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:29:58.333000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029f7b4-43b2-4046-9fb1-44ef1a49617a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:58.444136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029f7b4-43b2-4046-9fb1-44ef1a49617a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:58.477629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4469e07-d011-406d-83b2-b459ba38f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:58.478376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4469e07-d011-406d-83b2-b459ba38f91c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:58.478657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4469e07-d011-406d-83b2-b459ba38f91c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:58.478932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4469e07-d011-406d-83b2-b459ba38f91c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:58.488731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4469e07-d011-406d-83b2-b459ba38f91c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c4469e07-d011-406d-83b2-b459ba38f91c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:29:58.497227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:58.498235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:29:58.504379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 628/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Mon May 16 17:29:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:58.505209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3924f35-aa80-4fee-ad6c-c9693643d5f0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:58.613029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3924f35-aa80-4fee-ad6c-c9693643d5f0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:58.651614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:58.652336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:58.652614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:58.652898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:58.653831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:58.654139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:58.655660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:58.664138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 608/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Mon May 16 17:29:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:58.670512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4469e07-d011-406d-83b2-b459ba38f91c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:58.771543 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4469e07-d011-406d-83b2-b459ba38f91c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:58.805158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:58.805979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:58.806256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:58.806528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:58.816903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:58.818432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:29:58.835394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:58.836497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:58.837793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:29:58.837793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:29:58.837793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:58.837793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:29:58.837793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 629/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:58.842567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:58.944938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b81f-5a3a-42cd-bea4-a4e6d26f5d49 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:58.979436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:58.980169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:58.980439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:58.980710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:58.981531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:58.981917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:58.983357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:58.995633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 609/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:29:59.001621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:59.112850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf14f2-bf11-45fe-bbf7-dcac7bd3ed91 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:59.148531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:59.149501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:59.149819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:59.150094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:59.157750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:59.159448 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:29:59.174629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:59.175794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:29:59.177675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 630/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:29:59.182476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:59.287612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab6178-6f70-4faa-9e72-33240a2825f1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:59.326159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:59.326929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:59.327245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:59.327512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:59.328342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:29:59.328644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:59.330217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:59.348259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 610/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Mon May 16 17:29:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:29:59.354525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:59.456332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0cffe-5e3b-494b-a7cd-ccedb47bf91a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:59.491376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb074af-1ef0-4c71-8dd4-70e8d22c098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:59.492026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb074af-1ef0-4c71-8dd4-70e8d22c098a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:59.492305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb074af-1ef0-4c71-8dd4-70e8d22c098a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:59.492574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb074af-1ef0-4c71-8dd4-70e8d22c098a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:59.568483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb074af-1ef0-4c71-8dd4-70e8d22c098a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:59.570322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb074af-1ef0-4c71-8dd4-70e8d22c098a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:59.677894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 631/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:29:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:29:59.684903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:59.796723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7173d0b-c229-4fd1-856a-8008c95030ae None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:29:59.840639 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:29:59.841445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:29:59.841808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:29:59.842074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:29:59.852368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:29:59.853840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:29:59.872225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:29:59.873215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:29:59.878856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:29:59.878856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:29:59.878856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:29:59.878856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:29:59.878856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 611/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:29:59.879791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb074af-1ef0-4c71-8dd4-70e8d22c098a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:29:59.988948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb074af-1ef0-4c71-8dd4-70e8d22c098a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:00.025301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:00.026001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:00.026283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:00.026553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:00.027269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:00.027571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:00.028954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:00.043108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 632/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:30:00.049756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:00.163519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7f7eb-9dd5-4364-b4c4-7e06fb817d48 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:00.201827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:00.202787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:00.203066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:00.203418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:00.212103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:00.213559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:30:00.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:00.228409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:00.229502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 612/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:00.234721 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:00.341237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af319ec5-011b-4faf-9d12-edcf98d6c835 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:00.378187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4da9b-05f7-4c6e-b8e3-8023982bbb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:00.379200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4da9b-05f7-4c6e-b8e3-8023982bbb87 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:00.379557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4da9b-05f7-4c6e-b8e3-8023982bbb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:00.379871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4da9b-05f7-4c6e-b8e3-8023982bbb87 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:00.380907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4da9b-05f7-4c6e-b8e3-8023982bbb87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:00.381294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4da9b-05f7-4c6e-b8e3-8023982bbb87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:00.383120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4da9b-05f7-4c6e-b8e3-8023982bbb87 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:00.397833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 633/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:00.404182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:00.514393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571592f5-3efd-496d-af06-24c2898edef9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:00.548569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79086d5-d992-4589-9028-fe9154777f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:00.549230 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79086d5-d992-4589-9028-fe9154777f79 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:00.549505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79086d5-d992-4589-9028-fe9154777f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:00.549803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79086d5-d992-4589-9028-fe9154777f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:00.550683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79086d5-d992-4589-9028-fe9154777f79 None admin] RBAC: Adding query filter params (role.id=117a8af4218c4823b9f45e58df8c8be1, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=02938c77178a4f14a33ff1298775687c) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:00.550992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79086d5-d992-4589-9028-fe9154777f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:00.552626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79086d5-d992-4589-9028-fe9154777f79 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:00.560156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 613/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:30:00 2022] GET /identity/v3/role_assignments?user.id=02938c77178a4f14a33ff1298775687c&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=117a8af4218c4823b9f45e58df8c8be1 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:02.820688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fbdc8-7a3e-44a9-9655-ebd54a543c73 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:02.821318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fbdc8-7a3e-44a9-9655-ebd54a543c73 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:02.821318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fbdc8-7a3e-44a9-9655-ebd54a543c73 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:02.822977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 634/1247] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:30:02.828261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791cca4-e4ff-4684-8cc0-d1bf76985935 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:02.828683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791cca4-e4ff-4684-8cc0-d1bf76985935 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:02.828814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791cca4-e4ff-4684-8cc0-d1bf76985935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:02.847088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a791cca4-e4ff-4684-8cc0-d1bf76985935 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:30:02.848463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a791cca4-e4ff-4684-8cc0-d1bf76985935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:30:02.919138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 614/1248] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:30:02.944767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fbdc8-7a3e-44a9-9655-ebd54a543c73 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:03.053510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fbdc8-7a3e-44a9-9655-ebd54a543c73 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:03.089982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e8f8-f250-4c78-b606-36b7c45a195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:03.090757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e8f8-f250-4c78-b606-36b7c45a195f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:03.091027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e8f8-f250-4c78-b606-36b7c45a195f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:03.091314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e8f8-f250-4c78-b606-36b7c45a195f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:03.102432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14e8f8-f250-4c78-b606-36b7c45a195f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9c14e8f8-f250-4c78-b606-36b7c45a195f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:30:03.110492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:03.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:03.112620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 635/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:03.118285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791cca4-e4ff-4684-8cc0-d1bf76985935 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:03.221690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791cca4-e4ff-4684-8cc0-d1bf76985935 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:03.260930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:03.261648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:03.261922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:03.262195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:03.262944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:03.263242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:03.264676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:03.272963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 615/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:03.279616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e8f8-f250-4c78-b606-36b7c45a195f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:03.388808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e8f8-f250-4c78-b606-36b7c45a195f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:03.428835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:03.429942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:03.430232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:03.430512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:03.444484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:03.446320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:30:03.465408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:03.466414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:03.473977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:30:03.473977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:30:03.473977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:03.473977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:03.473977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 636/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:03.474289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:03.582424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc7cc-b637-4c12-9c9c-6bda9cf3e7d7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:03.623789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:03.624608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:03.625023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:03.625300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:03.626292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:03.626637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:03.628259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:03.641918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 616/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:03.647185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:03.755385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83346f-ed6f-4726-a764-7a8f122a597e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:03.791577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:03.792501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:03.792808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:03.793110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:03.802824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:03.804498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:30:03.820342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:03.822114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:03.823295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 637/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:03.827755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:03.934849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dfa90-6440-4375-8b02-4f0a06299747 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:03.972628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:03.973364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:03.973708 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:03.974091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:03.975137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:03.975445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:03.976891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:03.996159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 617/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Mon May 16 17:30:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:04.002156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:04.116200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e10a1-9370-4e92-a349-e23eb1e87f24 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:04.152912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1fc4e-489c-4613-b61b-2bbc855a6074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:04.153685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1fc4e-489c-4613-b61b-2bbc855a6074 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:04.153958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1fc4e-489c-4613-b61b-2bbc855a6074 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:04.154223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1fc4e-489c-4613-b61b-2bbc855a6074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:04.227250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1fc4e-489c-4613-b61b-2bbc855a6074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:04.229182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1fc4e-489c-4613-b61b-2bbc855a6074 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:04.336285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 638/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:30:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:30:04.342067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:04.449712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efac016-29dd-47c5-9318-c0517d769404 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:04.484430 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:04.485195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:04.485474 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:04.485856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:04.496317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:04.497920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:30:04.516367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:04.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:04.523191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:30:04.523191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:30:04.523191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:04.523191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:04.523191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 618/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:04.523511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1fc4e-489c-4613-b61b-2bbc855a6074 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:04.649333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1fc4e-489c-4613-b61b-2bbc855a6074 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:04.688885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:04.689668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:04.689970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:04.690215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:04.690946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:04.691260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:04.692651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:04.708770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 639/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:04.709948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:04.811947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc024a-17d5-4cc4-8f2c-80e19d3575cf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:04.846505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:04.847569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:04.847930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:04.848310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:04.856142 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:04.858104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:30:04.873269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:04.874468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:04.875481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 619/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:30:04.880846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:04.987843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf962-1e7b-4f0a-aacf-24a475493bca None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:05.023706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b32115-a8a0-4da9-841c-ffe8201c19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:05.024372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32115-a8a0-4da9-841c-ffe8201c19bd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:05.024652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32115-a8a0-4da9-841c-ffe8201c19bd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:05.024926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32115-a8a0-4da9-841c-ffe8201c19bd None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:05.025749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b32115-a8a0-4da9-841c-ffe8201c19bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:05.026166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b32115-a8a0-4da9-841c-ffe8201c19bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:05.027636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b32115-a8a0-4da9-841c-ffe8201c19bd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:05.039560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 640/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:05.045802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:05.150971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87ee2-309a-4859-8ecf-6c2ac37123ad None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:05.185910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84690cfb-2a97-48df-8a23-e7a5e9204502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:05.186546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690cfb-2a97-48df-8a23-e7a5e9204502 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:05.186875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690cfb-2a97-48df-8a23-e7a5e9204502 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:05.187153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690cfb-2a97-48df-8a23-e7a5e9204502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:05.188059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84690cfb-2a97-48df-8a23-e7a5e9204502 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=02938c77178a4f14a33ff1298775687c) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:05.188383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84690cfb-2a97-48df-8a23-e7a5e9204502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:05.189968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84690cfb-2a97-48df-8a23-e7a5e9204502 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:05.195808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 620/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:30:05 2022] GET /identity/v3/role_assignments?user.id=02938c77178a4f14a33ff1298775687c&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:07.409374 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ad7b-bce2-41b8-9797-1ba1e999765a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:07.410001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ad7b-bce2-41b8-9797-1ba1e999765a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:07.410001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ad7b-bce2-41b8-9797-1ba1e999765a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:07.411458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 641/1261] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:30:07.417906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43d28-7e39-4613-9c2d-ff4642f9924b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:07.418625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43d28-7e39-4613-9c2d-ff4642f9924b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:07.418778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43d28-7e39-4613-9c2d-ff4642f9924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:07.446023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f6d43d28-7e39-4613-9c2d-ff4642f9924b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:30:07.447183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f6d43d28-7e39-4613-9c2d-ff4642f9924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:30:07.515331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 621/1262] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:30:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:30:07.544680 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ad7b-bce2-41b8-9797-1ba1e999765a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:07.654893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ad7b-bce2-41b8-9797-1ba1e999765a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:07.688670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb1b1-ab1e-4ad0-97a0-1ee877101bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:07.689442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb1b1-ab1e-4ad0-97a0-1ee877101bba None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:07.689746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb1b1-ab1e-4ad0-97a0-1ee877101bba None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:07.690012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb1b1-ab1e-4ad0-97a0-1ee877101bba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:07.700814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb1b1-ab1e-4ad0-97a0-1ee877101bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4dbdb1b1-ab1e-4ad0-97a0-1ee877101bba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:30:07.708186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:07.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:07.710348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 642/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:30:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:07.716064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d43d28-7e39-4613-9c2d-ff4642f9924b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:07.823558 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d43d28-7e39-4613-9c2d-ff4642f9924b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:07.857093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:07.857774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:07.858051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:07.858321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:07.859054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:07.859356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:07.860736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:07.868871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 622/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:30:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:30:07.878288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb1b1-ab1e-4ad0-97a0-1ee877101bba None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:07.997406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb1b1-ab1e-4ad0-97a0-1ee877101bba None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:08.030457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:08.031223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:08.031498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:08.031767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:08.042307 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:08.043752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:30:08.060744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:08.061885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:08.062951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:30:08.062951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:30:08.062951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:08.062951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:08.062951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 643/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:08.068500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:08.183421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b108-2359-4543-9259-979b18147a4f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:08.220983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:08.221995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:08.222349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:08.222719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:08.223647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:08.223943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:08.225295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:08.238635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 623/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:08.247667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:08.354765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb7bf-b6d2-4f26-9f85-222c83528da1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:08.388087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:08.388897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:08.389171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:08.389438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:08.397032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:08.398584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:30:08.412683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:08.414192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 17:30:08.415417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:08.417738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 644/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:08.419787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:08.528149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fa50c-25fc-4b80-b7f9-b98d9bff7e65 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:08.568045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:08.568810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:08.569121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:08.569401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:08.570317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:08.570662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:08.572340 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:08.593325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 624/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Mon May 16 17:30:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:08.599845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:08.703864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71a2c4-017f-4815-997e-8d1dfe0f6333 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:08.740647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:08.741414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:08.741714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:08.741981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:08.753364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:08.754877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:30:08.771331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:08.772326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:08.773424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:30:08.773424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:30:08.773424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:08.773424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:08.777125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 645/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:08.778324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:08.874457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61537e4a-629c-4d10-b93a-066053ce64f3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:08.907335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:08.907967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:08.908239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:08.908505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:08.909203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:08.909501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:08.910943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:08.921911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 625/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:30:08.928024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:09.026319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8ed77-1290-4b6d-a596-e06229464ed6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:09.063247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:09.063944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:09.064218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:09.064483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:09.071774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:09.073193 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:30:09.087501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:09.088540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:09.089591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 646/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:09.095139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:09.204046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0329c-3acd-4f0c-8216-dcc0a8fa8a35 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:09.238515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4294c4-9e84-4157-ae1f-7496c5a343ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:09.239213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4294c4-9e84-4157-ae1f-7496c5a343ee None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:09.239491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4294c4-9e84-4157-ae1f-7496c5a343ee None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:09.239769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4294c4-9e84-4157-ae1f-7496c5a343ee None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:09.240552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4294c4-9e84-4157-ae1f-7496c5a343ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:09.240856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4294c4-9e84-4157-ae1f-7496c5a343ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:09.242319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4294c4-9e84-4157-ae1f-7496c5a343ee None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:09.254232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 626/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:30:09.260905 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:09.373742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a304d-ddad-4f6e-bf1c-5fffadef3712 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:09.407184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c12147-a160-4106-883b-084f65157a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:09.408103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c12147-a160-4106-883b-084f65157a75 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:09.408352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c12147-a160-4106-883b-084f65157a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:09.408631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c12147-a160-4106-883b-084f65157a75 None admin] PATH_INFO: `/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/02938c77178a4f14a33ff1298775687c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:09.410734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c12147-a160-4106-883b-084f65157a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c3d22278c4adc865f69d685d6fb5c, user_id=02938c77178a4f14a33ff1298775687c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:09.412158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c12147-a160-4106-883b-084f65157a75 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:09.431746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 647/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Mon May 16 17:30:09 2022] PUT /identity/v3/projects/9e6c3d22278c4adc865f69d685d6fb5c/users/02938c77178a4f14a33ff1298775687c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:30:11.629007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337eef-0a15-4929-bf9b-eebd6f328c16 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:11.629958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337eef-0a15-4929-bf9b-eebd6f328c16 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:11.630071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337eef-0a15-4929-bf9b-eebd6f328c16 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:11.632136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 627/1274] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:30:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:30:11.638654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dc37b-8798-4285-b4f1-e86e1b720dd6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:11.639094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dc37b-8798-4285-b4f1-e86e1b720dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:11.639418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dc37b-8798-4285-b4f1-e86e1b720dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:11.659839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-213dc37b-8798-4285-b4f1-e86e1b720dd6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:30:11.661448 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-213dc37b-8798-4285-b4f1-e86e1b720dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:30:11.730745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 648/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:30:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:30:11.763445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7337eef-0a15-4929-bf9b-eebd6f328c16 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:11.862945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7337eef-0a15-4929-bf9b-eebd6f328c16 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:11.896213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feb4a0-28c6-4ac8-b474-be8aed67ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:11.896922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feb4a0-28c6-4ac8-b474-be8aed67ad1b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:11.897199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feb4a0-28c6-4ac8-b474-be8aed67ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:11.897466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feb4a0-28c6-4ac8-b474-be8aed67ad1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:11.907626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feb4a0-28c6-4ac8-b474-be8aed67ad1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-10feb4a0-28c6-4ac8-b474-be8aed67ad1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 17:30:11.915275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:11.916347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:11.917209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 628/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Mon May 16 17:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:11.925479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dc37b-8798-4285-b4f1-e86e1b720dd6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:12.033387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dc37b-8798-4285-b4f1-e86e1b720dd6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:12.076112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:12.076767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:12.077045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:12.077316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:12.078091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:12.078397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:12.079777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:12.087850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 649/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Mon May 16 17:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:12.096293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feb4a0-28c6-4ac8-b474-be8aed67ad1b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:12.200228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feb4a0-28c6-4ac8-b474-be8aed67ad1b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:12.234241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:12.235025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:12.235302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:12.235574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:12.246152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:12.247594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:30:12.264292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:12.265296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:12.266432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:30:12.266432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:30:12.266432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:12.266432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:12.266432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 629/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:30:12.272387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:12.375977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8465-3858-46fe-ad0b-9c6fdbed94e9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:12.409117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:12.409787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:12.410064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:12.410386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:12.411183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:12.411489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:12.412845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:12.424706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 650/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:12.430431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:12.533240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e844837-ea7c-4f70-aa3a-47988690c107 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:12.567043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:12.568096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:12.568459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:12.568704 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:12.577563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:12.580774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 17:30:12.600119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:12.601307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:12.602626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 630/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:12.608295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:12.707953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01406811-1c40-4cf7-a542-42a490885254 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:12.743973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:12.744622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:12.744898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:12.745165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:12.746023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:12.746329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:12.747769 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:12.765781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 651/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Mon May 16 17:30:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:12.771954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:12.876282 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749ba3b-a33d-487d-ae1c-0feaaf6de4b0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:12.916350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90dc7e-1777-40ff-9a8b-983ec02c9eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:12.916987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dc7e-1777-40ff-9a8b-983ec02c9eda None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:12.917269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dc7e-1777-40ff-9a8b-983ec02c9eda None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:12.917532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dc7e-1777-40ff-9a8b-983ec02c9eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:12.983195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90dc7e-1777-40ff-9a8b-983ec02c9eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:12.984641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90dc7e-1777-40ff-9a8b-983ec02c9eda None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:13.081673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 631/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Mon May 16 17:30:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 17:30:13.090150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:13.200973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad808aa-73e3-44d4-b0c1-b4a9eb3ec89a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:13.234967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:13.235750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:13.236043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:13.236309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:13.246294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:13.247750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 17:30:13.264906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:13.265887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:13.266785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 17:30:13.266785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 17:30:13.266785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 17:30:13.266785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:13.266785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 652/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 17:30:13.274177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90dc7e-1777-40ff-9a8b-983ec02c9eda None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:13.370414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90dc7e-1777-40ff-9a8b-983ec02c9eda None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:13.404330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:13.404977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:13.405254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:13.405529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:13.406272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:13.406576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:13.407933 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:13.419053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 632/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Mon May 16 17:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:30:13.428322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:13.540428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05c35f-0336-4ca3-b291-5f6fed72ec96 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:13.582288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:13.583304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:13.583685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:13.583856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:13.591326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:13.592834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 17:30:13.606926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:13.607959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 16 17:30:13.609019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 653/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Mon May 16 17:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:13.614339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:13.712708 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a4f7-60f6-4ac0-b247-31c34415f528 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:13.745958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9ba6a-d85f-4a2c-99bf-91b64dccc9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:13.746599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ba6a-d85f-4a2c-99bf-91b64dccc9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:13.746878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ba6a-d85f-4a2c-99bf-91b64dccc9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:13.747154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ba6a-d85f-4a2c-99bf-91b64dccc9b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:13.747939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9ba6a-d85f-4a2c-99bf-91b64dccc9b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:13.748244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9ba6a-d85f-4a2c-99bf-91b64dccc9b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:13.749704 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9ba6a-d85f-4a2c-99bf-91b64dccc9b5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:13.761575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 633/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Mon May 16 17:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:30:13.768420 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:13.871341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1d795-ccb8-42fd-b398-485261852fb2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:13.904390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57949c-616e-49f7-beb9-1ade31e19ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:13.905023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57949c-616e-49f7-beb9-1ade31e19ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:13.905297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57949c-616e-49f7-beb9-1ade31e19ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:13.905592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57949c-616e-49f7-beb9-1ade31e19ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:13.906398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57949c-616e-49f7-beb9-1ade31e19ce0 None admin] RBAC: Adding query filter params (role.id=32f2dacc897642adb3cc1fab4d3b8202, scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c, user.id=02938c77178a4f14a33ff1298775687c) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:13.906702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57949c-616e-49f7-beb9-1ade31e19ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:13.908114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57949c-616e-49f7-beb9-1ade31e19ce0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:13.914039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 654/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Mon May 16 17:30:13 2022] GET /identity/v3/role_assignments?user.id=02938c77178a4f14a33ff1298775687c&scope.project.id=9e6c3d22278c4adc865f69d685d6fb5c&role.id=32f2dacc897642adb3cc1fab4d3b8202 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:16.103160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0528-690e-4f95-9374-36362c3721e4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:16.104008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0528-690e-4f95-9374-36362c3721e4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:16.104008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0528-690e-4f95-9374-36362c3721e4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:16.106239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 634/1288] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:30:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:30:16.114269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef56946-2283-4d74-9579-bd8303cc3d76 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:16.114706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef56946-2283-4d74-9579-bd8303cc3d76 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:16.114816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef56946-2283-4d74-9579-bd8303cc3d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:16.132875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1ef56946-2283-4d74-9579-bd8303cc3d76 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:30:16.134046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1ef56946-2283-4d74-9579-bd8303cc3d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:30:16.201518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 655/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:30:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:30:16.223874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d0528-690e-4f95-9374-36362c3721e4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:16.338298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d0528-690e-4f95-9374-36362c3721e4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:16.371194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:16.371905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:16.372177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:16.372440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:16.373077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:16.374458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:16.386194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:16.387374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:16.388234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 635/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:30:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:16.393686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef56946-2283-4d74-9579-bd8303cc3d76 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:16.505519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef56946-2283-4d74-9579-bd8303cc3d76 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:16.542006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e874927-10bc-479e-94e5-f41675eaaab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:16.542666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874927-10bc-479e-94e5-f41675eaaab4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:16.542944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874927-10bc-479e-94e5-f41675eaaab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:16.543225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e874927-10bc-479e-94e5-f41675eaaab4 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:16.543930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e874927-10bc-479e-94e5-f41675eaaab4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:16.544235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e874927-10bc-479e-94e5-f41675eaaab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:16.545640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e874927-10bc-479e-94e5-f41675eaaab4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:16.551011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 656/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Mon May 16 17:30:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:16.560440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:16.683686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9521-2988-4ad8-bdd4-2e4a62d744ed None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:16.718529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fbb58-553e-4675-b045-da17cf7b3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:16.719180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbb58-553e-4675-b045-da17cf7b3a97 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:16.719453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbb58-553e-4675-b045-da17cf7b3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:16.719723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbb58-553e-4675-b045-da17cf7b3a97 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:16.720418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fbb58-553e-4675-b045-da17cf7b3a97 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:16.720715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fbb58-553e-4675-b045-da17cf7b3a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:16.722114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fbb58-553e-4675-b045-da17cf7b3a97 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:16.726407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 636/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Mon May 16 17:30:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:18.902268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d526a-73df-484d-aaf1-099bfcb4479a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:18.903215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d526a-73df-484d-aaf1-099bfcb4479a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:18.903215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d526a-73df-484d-aaf1-099bfcb4479a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:18.905354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 657/1293] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:30:18.911716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e25cd-f74c-415a-a88f-57470731cd1b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:18.912150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e25cd-f74c-415a-a88f-57470731cd1b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:18.912308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e25cd-f74c-415a-a88f-57470731cd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:18.934989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d65e25cd-f74c-415a-a88f-57470731cd1b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:30:18.936186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d65e25cd-f74c-415a-a88f-57470731cd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:30:19.002988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 637/1294] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:30:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:30:19.025271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d526a-73df-484d-aaf1-099bfcb4479a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:19.134950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d526a-73df-484d-aaf1-099bfcb4479a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:19.171619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0f86a-5ebe-4709-b6a9-008bc7ce4960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:19.172514 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0f86a-5ebe-4709-b6a9-008bc7ce4960 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:19.172791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0f86a-5ebe-4709-b6a9-008bc7ce4960 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:19.173057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0f86a-5ebe-4709-b6a9-008bc7ce4960 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:19.173801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0f86a-5ebe-4709-b6a9-008bc7ce4960 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:19.175174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0f86a-5ebe-4709-b6a9-008bc7ce4960 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:19.191455 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 658/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Mon May 16 17:30:19 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:30:21.390593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bfc87-1525-4f2a-8d3a-887c267c9648 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:21.391483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bfc87-1525-4f2a-8d3a-887c267c9648 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:21.391483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bfc87-1525-4f2a-8d3a-887c267c9648 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:21.393733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 638/1296] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:30:21.399402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824af4-c106-45d7-8518-c5dacfb07f75 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:21.399818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824af4-c106-45d7-8518-c5dacfb07f75 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:21.399928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824af4-c106-45d7-8518-c5dacfb07f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:21.418281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-65824af4-c106-45d7-8518-c5dacfb07f75 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:30:21.419443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-65824af4-c106-45d7-8518-c5dacfb07f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:30:21.503224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 659/1297] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:30:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 17:30:21.526284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bfc87-1525-4f2a-8d3a-887c267c9648 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:21.643542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bfc87-1525-4f2a-8d3a-887c267c9648 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:21.677592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:21.678409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:21.678688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:21.678959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:21.679605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:21.680980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:21.693150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:21.694326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:21.695341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 639/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:30:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:21.700893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824af4-c106-45d7-8518-c5dacfb07f75 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:21.807126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824af4-c106-45d7-8518-c5dacfb07f75 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:21.848953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:21.849935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:21.850278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:21.850643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:21.851706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:21.852112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:21.854288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:21.862762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 660/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Mon May 16 17:30:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:21.872245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:21.984945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dda5d6-b5da-45fc-8186-b703c7741513 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:22.018544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19493064-093c-464d-a388-4e3d5d69e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:22.019205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493064-093c-464d-a388-4e3d5d69e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:22.019533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493064-093c-464d-a388-4e3d5d69e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:22.019802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19493064-093c-464d-a388-4e3d5d69e9a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:22.020582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19493064-093c-464d-a388-4e3d5d69e9a2 None admin] RBAC: Adding query filter params (interface=public, service_id=595040e26cfa4b338889e6e75b59d73d, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:22.020882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19493064-093c-464d-a388-4e3d5d69e9a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:22.022283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19493064-093c-464d-a388-4e3d5d69e9a2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:22.027292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 640/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Mon May 16 17:30:21 2022] GET /identity/v3/endpoints?service_id=595040e26cfa4b338889e6e75b59d73d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:22.033171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:22.151182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcddbcb-a402-484d-a5ff-8cd79c95c22d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:22.191392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62a5e3-36ce-459e-b8f4-a812e86510a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:22.192061 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a5e3-36ce-459e-b8f4-a812e86510a2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:22.192345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a5e3-36ce-459e-b8f4-a812e86510a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:22.192625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a5e3-36ce-459e-b8f4-a812e86510a2 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:22.193301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62a5e3-36ce-459e-b8f4-a812e86510a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:22.194711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62a5e3-36ce-459e-b8f4-a812e86510a2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:22.201615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 661/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Mon May 16 17:30:22 2022] GET /identity/v3/services => generated 2191 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:30:24.387458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075389-42fc-4cf7-97b8-d29e92932d4a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:24.388346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075389-42fc-4cf7-97b8-d29e92932d4a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:24.388346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075389-42fc-4cf7-97b8-d29e92932d4a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:24.390531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 641/1302] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:30:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:30:24.397509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442af6-9c81-452f-a4fc-5823ec04116a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:24.397989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442af6-9c81-452f-a4fc-5823ec04116a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:24.398080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442af6-9c81-452f-a4fc-5823ec04116a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:24.415902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-37442af6-9c81-452f-a4fc-5823ec04116a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:30:24.417088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-37442af6-9c81-452f-a4fc-5823ec04116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:30:24.483626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 662/1303] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:30:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 17:30:24.506487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075389-42fc-4cf7-97b8-d29e92932d4a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:24.617178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075389-42fc-4cf7-97b8-d29e92932d4a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:24.652134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:24.652919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:24.653193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:24.653468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] PATH_INFO: `/v3/services/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:24.654145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:24.655506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:30:24.668023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:30:24.669136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 16 17:30:24.670252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 642/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Mon May 16 17:30:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 17:30:24.678176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37442af6-9c81-452f-a4fc-5823ec04116a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:24.780707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37442af6-9c81-452f-a4fc-5823ec04116a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:24.821280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045309c3-481d-440f-aae0-5fa68af1172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:24.821975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045309c3-481d-440f-aae0-5fa68af1172d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:24.822256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045309c3-481d-440f-aae0-5fa68af1172d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:24.822528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045309c3-481d-440f-aae0-5fa68af1172d None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:24.823237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045309c3-481d-440f-aae0-5fa68af1172d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:30:24.823540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045309c3-481d-440f-aae0-5fa68af1172d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:24.824912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045309c3-481d-440f-aae0-5fa68af1172d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:24.830185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 663/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Mon May 16 17:30:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:30:24.838867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:24.952577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7070-60cd-445e-9931-35d3e4f23eba None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:24.986018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa96a1-b5e6-44bd-946d-d90074c19a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:24.986657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa96a1-b5e6-44bd-946d-d90074c19a34 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:24.986934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa96a1-b5e6-44bd-946d-d90074c19a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:24.987197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa96a1-b5e6-44bd-946d-d90074c19a34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:24.988010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa96a1-b5e6-44bd-946d-d90074c19a34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:24.989373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa96a1-b5e6-44bd-946d-d90074c19a34 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:25.011172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 643/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Mon May 16 17:30:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:28.720772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9383-c968-4a86-96da-5b9698ed479e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:28.721385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9383-c968-4a86-96da-5b9698ed479e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:28.721385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9383-c968-4a86-96da-5b9698ed479e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:28.723976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 664/1307] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:28.729701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b78e0-b28b-4ea0-ab5c-1a44fc9ccdd5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:28.730131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b78e0-b28b-4ea0-ab5c-1a44fc9ccdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:28.730234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b78e0-b28b-4ea0-ab5c-1a44fc9ccdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:28.818172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-884b78e0-b28b-4ea0-ab5c-1a44fc9ccdd5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:28.821034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-884b78e0-b28b-4ea0-ab5c-1a44fc9ccdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:28.980525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 644/1308] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:29.029944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb41f3-af8d-487e-a86f-8d2274ec3c4c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:29.030495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb41f3-af8d-487e-a86f-8d2274ec3c4c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:29.030903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb41f3-af8d-487e-a86f-8d2274ec3c4c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:29.032821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 665/1309] 10.222.0.58 () {54 vars in 964 bytes} [Mon May 16 17:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:29.039072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7aae3-60e3-4aff-b771-1d5767512510 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:29.039631 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7aae3-60e3-4aff-b771-1d5767512510 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:29.040054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7aae3-60e3-4aff-b771-1d5767512510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:29.123691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5ca7aae3-60e3-4aff-b771-1d5767512510 None None] MFA Rules not processed for user `2fddf039f65a4cff95c9c2041dd81ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:29.124950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5ca7aae3-60e3-4aff-b771-1d5767512510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:29.209612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 645/1310] 10.222.0.58 () {58 vars in 1061 bytes} [Mon May 16 17:31:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:29.218737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb41f3-af8d-487e-a86f-8d2274ec3c4c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:29.220513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-13fb41f3-af8d-487e-a86f-8d2274ec3c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:29.328070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb41f3-af8d-487e-a86f-8d2274ec3c4c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:29.403259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8f975-66ba-45a1-9aa3-b4b71ce5a9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:29.403883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8f975-66ba-45a1-9aa3-b4b71ce5a9ba service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:29.404161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8f975-66ba-45a1-9aa3-b4b71ce5a9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:29.404465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8f975-66ba-45a1-9aa3-b4b71ce5a9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:29.406085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e1f8f975-66ba-45a1-9aa3-b4b71ce5a9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:29.518627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8f975-66ba-45a1-9aa3-b4b71ce5a9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:29.520067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8f975-66ba-45a1-9aa3-b4b71ce5a9ba service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:29.538995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 666/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:31.994778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5cd85-0063-4c87-912f-af1c77ecc7f5 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:31.995298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5cd85-0063-4c87-912f-af1c77ecc7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:31.995298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5cd85-0063-4c87-912f-af1c77ecc7f5 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:31.996670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 646/1312] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:32.002279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad2d0-6831-416f-ac26-317b34e0089d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:32.002748 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad2d0-6831-416f-ac26-317b34e0089d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:32.002944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ad2d0-6831-416f-ac26-317b34e0089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:32.076985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-894ad2d0-6831-416f-ac26-317b34e0089d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:32.078208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-894ad2d0-6831-416f-ac26-317b34e0089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:32.237680 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 667/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:32.272427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5cd85-0063-4c87-912f-af1c77ecc7f5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:32.273979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c7a5cd85-0063-4c87-912f-af1c77ecc7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:32.379273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5cd85-0063-4c87-912f-af1c77ecc7f5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:32.452044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668d65e-3d96-4af3-bcd3-3d558af81b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:32.453079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668d65e-3d96-4af3-bcd3-3d558af81b26 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:32.453694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668d65e-3d96-4af3-bcd3-3d558af81b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:32.454168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668d65e-3d96-4af3-bcd3-3d558af81b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:32.456001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2668d65e-3d96-4af3-bcd3-3d558af81b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:32.563919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668d65e-3d96-4af3-bcd3-3d558af81b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:32.565407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668d65e-3d96-4af3-bcd3-3d558af81b26 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:32.585325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 647/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:35.116782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9444-3188-4bb3-b8f4-19eadb8404b9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:35.117751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9444-3188-4bb3-b8f4-19eadb8404b9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:35.117751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9444-3188-4bb3-b8f4-19eadb8404b9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:35.121128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 668/1315] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:35.127403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b6ad-8944-426e-80f0-f7774dc6c2f7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:35.127825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b6ad-8944-426e-80f0-f7774dc6c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:35.127955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b6ad-8944-426e-80f0-f7774dc6c2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:35.201276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0509b6ad-8944-426e-80f0-f7774dc6c2f7 None None] MFA Rules not processed for user `8462e07973b6479ab690bab71d456f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:35.202493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0509b6ad-8944-426e-80f0-f7774dc6c2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:35.304354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 648/1316] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:35.343665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9444-3188-4bb3-b8f4-19eadb8404b9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:35.345265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7dfa9444-3188-4bb3-b8f4-19eadb8404b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:35.453933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9444-3188-4bb3-b8f4-19eadb8404b9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:35.524802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d76247-7b97-46eb-a813-7bd47e3d8d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:35.525432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76247-7b97-46eb-a813-7bd47e3d8d05 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:35.525737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76247-7b97-46eb-a813-7bd47e3d8d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:35.526002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76247-7b97-46eb-a813-7bd47e3d8d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:35.527612 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f0d76247-7b97-46eb-a813-7bd47e3d8d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:35.644553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d76247-7b97-46eb-a813-7bd47e3d8d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:35.646021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d76247-7b97-46eb-a813-7bd47e3d8d05 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:35.664054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 669/1317] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:38.411183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af3f3-e660-4140-aedd-21da2dd55995 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:38.412021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af3f3-e660-4140-aedd-21da2dd55995 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:38.412021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af3f3-e660-4140-aedd-21da2dd55995 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:38.414378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 649/1318] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:38.421083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e33ae-9fe9-4400-a302-dabca28b7535 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:38.421525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e33ae-9fe9-4400-a302-dabca28b7535 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:38.421660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e33ae-9fe9-4400-a302-dabca28b7535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:38.487079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e22e33ae-9fe9-4400-a302-dabca28b7535 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:38.488194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e22e33ae-9fe9-4400-a302-dabca28b7535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:38.583326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 670/1319] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:38.636599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6bd83-6976-4dc2-906d-3af09d3d7028 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:38.636882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6bd83-6976-4dc2-906d-3af09d3d7028 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:38.637151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6bd83-6976-4dc2-906d-3af09d3d7028 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:38.638573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 650/1320] 10.222.0.58 () {54 vars in 964 bytes} [Mon May 16 17:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:38.644817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b88d0-cdc9-43b1-93fd-fb580163898a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:38.645103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b88d0-cdc9-43b1-93fd-fb580163898a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:38.645379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b88d0-cdc9-43b1-93fd-fb580163898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:38.717907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-404b88d0-cdc9-43b1-93fd-fb580163898a None None] MFA Rules not processed for user `2fddf039f65a4cff95c9c2041dd81ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:38.719161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-404b88d0-cdc9-43b1-93fd-fb580163898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:38.794453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 671/1321] 10.222.0.58 () {58 vars in 1061 bytes} [Mon May 16 17:31:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:38.804347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6bd83-6976-4dc2-906d-3af09d3d7028 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:38.806851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ccc6bd83-6976-4dc2-906d-3af09d3d7028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:38.919706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6bd83-6976-4dc2-906d-3af09d3d7028 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:39.005618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be98d76-4ef9-4562-ade9-322b63fbab71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:39.006190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98d76-4ef9-4562-ade9-322b63fbab71 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:39.006477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98d76-4ef9-4562-ade9-322b63fbab71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:39.006745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be98d76-4ef9-4562-ade9-322b63fbab71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:39.008453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1be98d76-4ef9-4562-ade9-322b63fbab71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:39.115253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be98d76-4ef9-4562-ade9-322b63fbab71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:39.116683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be98d76-4ef9-4562-ade9-322b63fbab71 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:39.134342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 651/1322] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:42.448501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede545-d293-49f3-92eb-2d32b580a66c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.449094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede545-d293-49f3-92eb-2d32b580a66c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.449094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede545-d293-49f3-92eb-2d32b580a66c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.450433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 672/1323] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:42.455985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1ab6b-231f-4008-b667-30e792fbea0d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.456411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1ab6b-231f-4008-b667-30e792fbea0d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.456411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1ab6b-231f-4008-b667-30e792fbea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.520750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a1c1ab6b-231f-4008-b667-30e792fbea0d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:42.521963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a1c1ab6b-231f-4008-b667-30e792fbea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.619414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 652/1324] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:42.654816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede545-d293-49f3-92eb-2d32b580a66c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.656424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-53ede545-d293-49f3-92eb-2d32b580a66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.760554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede545-d293-49f3-92eb-2d32b580a66c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.835358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f962-9032-470e-bfcd-79cbcbc3b1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.836011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f962-9032-470e-bfcd-79cbcbc3b1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.836259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f962-9032-470e-bfcd-79cbcbc3b1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.836521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f962-9032-470e-bfcd-79cbcbc3b1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.838218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-51d5f962-9032-470e-bfcd-79cbcbc3b1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.948177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f962-9032-470e-bfcd-79cbcbc3b1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.949682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f962-9032-470e-bfcd-79cbcbc3b1c9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.969103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 673/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:45.229756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2d3e-a545-4a96-a814-404d4b628870 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.230263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2d3e-a545-4a96-a814-404d4b628870 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.230263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2d3e-a545-4a96-a814-404d4b628870 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.231676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 653/1326] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:45.237111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806ba7-70ef-4c00-935d-f9721f053850 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.237537 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806ba7-70ef-4c00-935d-f9721f053850 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.237682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806ba7-70ef-4c00-935d-f9721f053850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.304966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-07806ba7-70ef-4c00-935d-f9721f053850 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:45.306173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-07806ba7-70ef-4c00-935d-f9721f053850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.403488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 674/1327] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:45.439216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2d3e-a545-4a96-a814-404d4b628870 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.440726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7fad2d3e-a545-4a96-a814-404d4b628870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.546752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2d3e-a545-4a96-a814-404d4b628870 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.618968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77608a-2070-4a91-a480-78874e383fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.619643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77608a-2070-4a91-a480-78874e383fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.619923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77608a-2070-4a91-a480-78874e383fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.620193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77608a-2070-4a91-a480-78874e383fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.621846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1c77608a-2070-4a91-a480-78874e383fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.732471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77608a-2070-4a91-a480-78874e383fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.733938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77608a-2070-4a91-a480-78874e383fd5 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.751905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 654/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:47.993772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a984d11-00d8-4f31-8532-d5a0e9f47634 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.994337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a984d11-00d8-4f31-8532-d5a0e9f47634 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.994337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a984d11-00d8-4f31-8532-d5a0e9f47634 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.995687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 675/1329] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:48.001287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524e93-4dfa-4a63-af9c-19ef51c675da None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:48.001760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524e93-4dfa-4a63-af9c-19ef51c675da None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:48.002000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524e93-4dfa-4a63-af9c-19ef51c675da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:48.068773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-93524e93-4dfa-4a63-af9c-19ef51c675da None None] MFA Rules not processed for user `8462e07973b6479ab690bab71d456f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:48.070004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-93524e93-4dfa-4a63-af9c-19ef51c675da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:48.163601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 655/1330] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:48.200756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a984d11-00d8-4f31-8532-d5a0e9f47634 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:48.202313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0a984d11-00d8-4f31-8532-d5a0e9f47634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:48.313604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a984d11-00d8-4f31-8532-d5a0e9f47634 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:48.385875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fa1ac-ed3f-4050-be10-2aa54cc1678e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:48.386518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa1ac-ed3f-4050-be10-2aa54cc1678e service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:48.386794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa1ac-ed3f-4050-be10-2aa54cc1678e service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:48.387063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa1ac-ed3f-4050-be10-2aa54cc1678e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:48.388703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c80fa1ac-ed3f-4050-be10-2aa54cc1678e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:48.500181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fa1ac-ed3f-4050-be10-2aa54cc1678e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:48.502155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fa1ac-ed3f-4050-be10-2aa54cc1678e service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:48.520208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 676/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:50.951842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3569-ddc9-44c7-af1a-f4e6f9b36226 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.952328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3569-ddc9-44c7-af1a-f4e6f9b36226 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.952439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3569-ddc9-44c7-af1a-f4e6f9b36226 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.953870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 656/1332] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:50.959608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee469ec-f23b-42ef-bc40-7592974ff38c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.960079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee469ec-f23b-42ef-bc40-7592974ff38c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.960186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee469ec-f23b-42ef-bc40-7592974ff38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.023431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5ee469ec-f23b-42ef-bc40-7592974ff38c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:51.024536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5ee469ec-f23b-42ef-bc40-7592974ff38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.123125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 677/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:51.158445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3569-ddc9-44c7-af1a-f4e6f9b36226 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.160010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-450d3569-ddc9-44c7-af1a-f4e6f9b36226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.265820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3569-ddc9-44c7-af1a-f4e6f9b36226 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.338981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4f8c-91a4-4294-9de5-c6993adf4b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.339545 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4f8c-91a4-4294-9de5-c6993adf4b8a service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.339826 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4f8c-91a4-4294-9de5-c6993adf4b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.340097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4f8c-91a4-4294-9de5-c6993adf4b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.341793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-685f4f8c-91a4-4294-9de5-c6993adf4b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.457371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f4f8c-91a4-4294-9de5-c6993adf4b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.459692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f4f8c-91a4-4294-9de5-c6993adf4b8a service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.481460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 657/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:53.749208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707be7-2cc8-4cde-91e1-b0a84eb5f5cb None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:53.750278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707be7-2cc8-4cde-91e1-b0a84eb5f5cb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:53.750278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707be7-2cc8-4cde-91e1-b0a84eb5f5cb None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:53.752509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 678/1335] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:31:53.758863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d467a-6b25-42aa-a2dc-9964bc0facb6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:53.759637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d467a-6b25-42aa-a2dc-9964bc0facb6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:53.759817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d467a-6b25-42aa-a2dc-9964bc0facb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:53.847813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-230d467a-6b25-42aa-a2dc-9964bc0facb6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:53.849034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-230d467a-6b25-42aa-a2dc-9964bc0facb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:53.955019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 658/1336] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:53.998043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19707be7-2cc8-4cde-91e1-b0a84eb5f5cb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:54.000385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-19707be7-2cc8-4cde-91e1-b0a84eb5f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:54.106267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19707be7-2cc8-4cde-91e1-b0a84eb5f5cb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:54.189584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b87a-dd01-4e5e-bb5a-c9982ddd57f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:54.190257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b87a-dd01-4e5e-bb5a-c9982ddd57f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:54.190522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b87a-dd01-4e5e-bb5a-c9982ddd57f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:54.190805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b87a-dd01-4e5e-bb5a-c9982ddd57f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:54.192435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2196b87a-dd01-4e5e-bb5a-c9982ddd57f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:54.307396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b87a-dd01-4e5e-bb5a-c9982ddd57f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:54.308762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b87a-dd01-4e5e-bb5a-c9982ddd57f4 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:54.326793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 679/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:56.928654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec19b5-d90c-4d7a-91fb-fc3658caa7a5 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:56.929214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec19b5-d90c-4d7a-91fb-fc3658caa7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:56.929214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec19b5-d90c-4d7a-91fb-fc3658caa7a5 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:56.930632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 659/1338] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:31:56.936942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390aa9b-97fa-475d-bd51-bec2fd614bc9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:56.937692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390aa9b-97fa-475d-bd51-bec2fd614bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:56.937784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390aa9b-97fa-475d-bd51-bec2fd614bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:57.016896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0390aa9b-97fa-475d-bd51-bec2fd614bc9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:57.018045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0390aa9b-97fa-475d-bd51-bec2fd614bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:57.112130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 680/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:31:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:57.149510 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec19b5-d90c-4d7a-91fb-fc3658caa7a5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:57.152153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b3ec19b5-d90c-4d7a-91fb-fc3658caa7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:57.266628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec19b5-d90c-4d7a-91fb-fc3658caa7a5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:57.351031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbf932-0a16-4f58-a6f2-e679441b7353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:57.351599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf932-0a16-4f58-a6f2-e679441b7353 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:57.351871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf932-0a16-4f58-a6f2-e679441b7353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:57.352135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf932-0a16-4f58-a6f2-e679441b7353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:57.353800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-88dbf932-0a16-4f58-a6f2-e679441b7353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:57.470253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbf932-0a16-4f58-a6f2-e679441b7353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:57.471700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbf932-0a16-4f58-a6f2-e679441b7353 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:57.490124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 660/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:31:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:01.756626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc70609-8c63-4bf8-8a96-4a22f352afb3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:01.757179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc70609-8c63-4bf8-8a96-4a22f352afb3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:01.757179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc70609-8c63-4bf8-8a96-4a22f352afb3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:01.758515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 681/1341] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:01.763922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce672ea-9db5-460f-a5dc-bc596017a778 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:01.764389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce672ea-9db5-460f-a5dc-bc596017a778 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:01.764513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce672ea-9db5-460f-a5dc-bc596017a778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:01.838780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6ce672ea-9db5-460f-a5dc-bc596017a778 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:01.839866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6ce672ea-9db5-460f-a5dc-bc596017a778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:01.946360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 661/1342] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:01.986100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc70609-8c63-4bf8-8a96-4a22f352afb3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:01.988817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9fc70609-8c63-4bf8-8a96-4a22f352afb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:02.086418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc70609-8c63-4bf8-8a96-4a22f352afb3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:02.090105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170430f-227f-4335-a5e0-36648e3d756f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:02.090687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170430f-227f-4335-a5e0-36648e3d756f service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:02.090961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170430f-227f-4335-a5e0-36648e3d756f service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:02.091212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170430f-227f-4335-a5e0-36648e3d756f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:02.100263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170430f-227f-4335-a5e0-36648e3d756f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:02.101724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170430f-227f-4335-a5e0-36648e3d756f service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:02.111074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 682/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:05.019204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df725e-2f00-49d0-b5ad-dc423c2cb98d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:05.019810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df725e-2f00-49d0-b5ad-dc423c2cb98d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:05.019810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df725e-2f00-49d0-b5ad-dc423c2cb98d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:05.021114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 662/1344] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:05.026568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ed23-2dae-4fc4-8a7c-a5d973742c78 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:05.027005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ed23-2dae-4fc4-8a7c-a5d973742c78 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:05.027216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ed23-2dae-4fc4-8a7c-a5d973742c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:05.055827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3977ed23-2dae-4fc4-8a7c-a5d973742c78 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:05.056993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3977ed23-2dae-4fc4-8a7c-a5d973742c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:05.134068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 683/1345] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:05.171062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df725e-2f00-49d0-b5ad-dc423c2cb98d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:05.182066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df725e-2f00-49d0-b5ad-dc423c2cb98d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:05.185752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016ea7b-0fce-4f85-ad79-324b5eb66700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:05.186408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016ea7b-0fce-4f85-ad79-324b5eb66700 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:05.186665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016ea7b-0fce-4f85-ad79-324b5eb66700 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:05.186931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016ea7b-0fce-4f85-ad79-324b5eb66700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:05.195878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016ea7b-0fce-4f85-ad79-324b5eb66700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:05.197286 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016ea7b-0fce-4f85-ad79-324b5eb66700 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:05.206839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 663/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:09.512723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198d7e7-f8ec-47d2-bd98-5f524115bbe2 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:09.513281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198d7e7-f8ec-47d2-bd98-5f524115bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:09.513281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198d7e7-f8ec-47d2-bd98-5f524115bbe2 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:09.514610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 684/1347] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:09.520031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408347ce-8b48-4b09-9b00-0ada2b0260af None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:09.520437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408347ce-8b48-4b09-9b00-0ada2b0260af None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:09.520583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408347ce-8b48-4b09-9b00-0ada2b0260af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:09.539335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-408347ce-8b48-4b09-9b00-0ada2b0260af None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:09.540528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-408347ce-8b48-4b09-9b00-0ada2b0260af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:09.553371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 664/1348] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:09.592212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198d7e7-f8ec-47d2-bd98-5f524115bbe2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:09.594101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b198d7e7-f8ec-47d2-bd98-5f524115bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:09.606491 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198d7e7-f8ec-47d2-bd98-5f524115bbe2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:09.610648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e136-849d-4471-9097-943bd4795926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:09.611625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e136-849d-4471-9097-943bd4795926 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:09.612104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e136-849d-4471-9097-943bd4795926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:09.612436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e136-849d-4471-9097-943bd4795926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:09.622814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e136-849d-4471-9097-943bd4795926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:09.624210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e136-849d-4471-9097-943bd4795926 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:09.633979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 685/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:14.797149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d490dd-f97f-4cd0-b3bc-88347ce4447d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:14.797638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d490dd-f97f-4cd0-b3bc-88347ce4447d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:14.797744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d490dd-f97f-4cd0-b3bc-88347ce4447d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:14.799115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 665/1350] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:14.804187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c327df-afac-4223-a8cc-95da9e3eafac None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:14.804998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c327df-afac-4223-a8cc-95da9e3eafac None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:14.805443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c327df-afac-4223-a8cc-95da9e3eafac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:14.962682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c7c327df-afac-4223-a8cc-95da9e3eafac None None] MFA Rules not processed for user `02938c77178a4f14a33ff1298775687c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:14.964271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c7c327df-afac-4223-a8cc-95da9e3eafac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:15.149928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 686/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:32:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:19.223292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406fe4-3cf5-48dd-9576-a96c8a30104c None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:19.223829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406fe4-3cf5-48dd-9576-a96c8a30104c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:19.223829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406fe4-3cf5-48dd-9576-a96c8a30104c None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:19.225793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 666/1352] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:19.231745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9718f-4d64-4acf-83c6-0a6a42273710 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:19.232170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9718f-4d64-4acf-83c6-0a6a42273710 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:19.232335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9718f-4d64-4acf-83c6-0a6a42273710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:19.251686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-98c9718f-4d64-4acf-83c6-0a6a42273710 None None] MFA Rules not processed for user `02938c77178a4f14a33ff1298775687c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:19.253168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-98c9718f-4d64-4acf-83c6-0a6a42273710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:19.264032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 687/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:32:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:20.825158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8261-5f70-486f-90f4-129f0fb9b9fd None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:20.825755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8261-5f70-486f-90f4-129f0fb9b9fd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:20.825755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8261-5f70-486f-90f4-129f0fb9b9fd None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:20.827112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 667/1354] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:20.832109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60487-034b-4e98-a97c-e24138a0a4dc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:20.832557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60487-034b-4e98-a97c-e24138a0a4dc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:20.832664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60487-034b-4e98-a97c-e24138a0a4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:20.852703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0ef60487-034b-4e98-a97c-e24138a0a4dc None None] MFA Rules not processed for user `02938c77178a4f14a33ff1298775687c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:20.853912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0ef60487-034b-4e98-a97c-e24138a0a4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:20.863562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 688/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:32:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:24.669314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2f68-6f3f-4d60-bb92-41e8f15a1089 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:24.669893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2f68-6f3f-4d60-bb92-41e8f15a1089 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:24.669893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2f68-6f3f-4d60-bb92-41e8f15a1089 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:24.671717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 668/1356] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:24.677154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7ccd-bf0a-49fa-9862-66ec175ad3fc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:24.677706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7ccd-bf0a-49fa-9862-66ec175ad3fc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:24.677706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7ccd-bf0a-49fa-9862-66ec175ad3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:24.696357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2a1c7ccd-bf0a-49fa-9862-66ec175ad3fc None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:24.697715 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2a1c7ccd-bf0a-49fa-9862-66ec175ad3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:24.709623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 689/1357] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:24.757455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e59c-9cc2-4905-beec-b0bc097099bf None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:24.757895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e59c-9cc2-4905-beec-b0bc097099bf None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:24.758275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e59c-9cc2-4905-beec-b0bc097099bf None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:24.759740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 669/1358] 10.222.0.58 () {54 vars in 961 bytes} [Mon May 16 17:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:24.765276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d61ba-b0bf-4ae2-b6be-cb2f269f9958 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:24.765692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d61ba-b0bf-4ae2-b6be-cb2f269f9958 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:24.765907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d61ba-b0bf-4ae2-b6be-cb2f269f9958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:24.817147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ce4d61ba-b0bf-4ae2-b6be-cb2f269f9958 None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:24.818672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ce4d61ba-b0bf-4ae2-b6be-cb2f269f9958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:24.905513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 690/1359] 10.222.0.58 () {58 vars in 1058 bytes} [Mon May 16 17:32:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:24.913473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e59c-9cc2-4905-beec-b0bc097099bf None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:24.930025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e59c-9cc2-4905-beec-b0bc097099bf None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:24.935942 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf81ca-98c0-4c7c-87d6-ba948948c901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:24.936983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf81ca-98c0-4c7c-87d6-ba948948c901 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:24.937505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf81ca-98c0-4c7c-87d6-ba948948c901 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:24.938202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf81ca-98c0-4c7c-87d6-ba948948c901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:24.946779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf81ca-98c0-4c7c-87d6-ba948948c901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:24.948827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf81ca-98c0-4c7c-87d6-ba948948c901 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:24.959470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 670/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:27.386316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac3dd-390c-4f92-83fd-be57f2d33fea None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.387203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac3dd-390c-4f92-83fd-be57f2d33fea None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.387485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac3dd-390c-4f92-83fd-be57f2d33fea None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.389069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 691/1361] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:27.394801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdd3cb-e267-49dc-a622-356ec38efcf4 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.395214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdd3cb-e267-49dc-a622-356ec38efcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.395352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdd3cb-e267-49dc-a622-356ec38efcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.413704 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2ecdd3cb-e267-49dc-a622-356ec38efcf4 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:27.414902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2ecdd3cb-e267-49dc-a622-356ec38efcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:27.438982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 671/1362] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:27.468127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac3dd-390c-4f92-83fd-be57f2d33fea None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.487826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac3dd-390c-4f92-83fd-be57f2d33fea None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.493800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c5429-6275-4577-bbae-2c3fae39666d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.494802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5429-6275-4577-bbae-2c3fae39666d service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.495185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5429-6275-4577-bbae-2c3fae39666d service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.495533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5429-6275-4577-bbae-2c3fae39666d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.505753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c5429-6275-4577-bbae-2c3fae39666d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.507432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c5429-6275-4577-bbae-2c3fae39666d service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.517286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 692/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:30.066536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7c128-0528-4b62-a6d5-44b467bd21ef None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:30.067015 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7c128-0528-4b62-a6d5-44b467bd21ef None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:30.067125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7c128-0528-4b62-a6d5-44b467bd21ef None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:30.068459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 672/1364] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:30.073906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593a8b2-b2c4-4d14-b8bb-54e425343bf1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:30.074336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593a8b2-b2c4-4d14-b8bb-54e425343bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:30.074478 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593a8b2-b2c4-4d14-b8bb-54e425343bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:30.092950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a593a8b2-b2c4-4d14-b8bb-54e425343bf1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:30.094784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a593a8b2-b2c4-4d14-b8bb-54e425343bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:30.102925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 693/1365] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:30.150204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156f01-8a40-4762-956b-e7ec5a7a851f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:30.150490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156f01-8a40-4762-956b-e7ec5a7a851f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:30.150775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156f01-8a40-4762-956b-e7ec5a7a851f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:30.152311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 673/1366] 10.222.0.58 () {54 vars in 961 bytes} [Mon May 16 17:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:30.161595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c477-7fb5-4022-973d-91aa4e7d8ff5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:30.161595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c477-7fb5-4022-973d-91aa4e7d8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:30.161595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c477-7fb5-4022-973d-91aa4e7d8ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:30.184573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d1d4c477-7fb5-4022-973d-91aa4e7d8ff5 None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:30.185904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d1d4c477-7fb5-4022-973d-91aa4e7d8ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:30.196086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 694/1367] 10.222.0.58 () {58 vars in 1058 bytes} [Mon May 16 17:32:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:30.203987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a156f01-8a40-4762-956b-e7ec5a7a851f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:30.217890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a156f01-8a40-4762-956b-e7ec5a7a851f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:30.223187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eae6e-b0d8-4292-b94c-cca50fa9bfa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:30.223823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eae6e-b0d8-4292-b94c-cca50fa9bfa2 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:30.224097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eae6e-b0d8-4292-b94c-cca50fa9bfa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:30.224366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eae6e-b0d8-4292-b94c-cca50fa9bfa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:30.232162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eae6e-b0d8-4292-b94c-cca50fa9bfa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:30.233781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eae6e-b0d8-4292-b94c-cca50fa9bfa2 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:30.242882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 674/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:32.497028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7652d68-d40e-4fa9-a84e-5231c80f2db3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.497609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7652d68-d40e-4fa9-a84e-5231c80f2db3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.497609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7652d68-d40e-4fa9-a84e-5231c80f2db3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.499199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 695/1369] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:32.504615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795a017-052a-4738-9902-3d4e6da49c91 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.505126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795a017-052a-4738-9902-3d4e6da49c91 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.505303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795a017-052a-4738-9902-3d4e6da49c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.523333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4795a017-052a-4738-9902-3d4e6da49c91 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:32.524635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4795a017-052a-4738-9902-3d4e6da49c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.533150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 675/1370] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:32.576653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7652d68-d40e-4fa9-a84e-5231c80f2db3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.594693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7652d68-d40e-4fa9-a84e-5231c80f2db3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.600858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7342d4-896e-45d4-8a89-7facf21cbd31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.601507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7342d4-896e-45d4-8a89-7facf21cbd31 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.601830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7342d4-896e-45d4-8a89-7facf21cbd31 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.602108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7342d4-896e-45d4-8a89-7facf21cbd31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.611077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7342d4-896e-45d4-8a89-7facf21cbd31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.612740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7342d4-896e-45d4-8a89-7facf21cbd31 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.622696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 696/1371] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:32.851533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489795b-0517-44c3-a8af-768f12a38c57 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.851844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489795b-0517-44c3-a8af-768f12a38c57 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.852048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489795b-0517-44c3-a8af-768f12a38c57 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.853747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 676/1372] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:32.860053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584278-841e-4dcd-acce-f4f014879c87 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.860667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584278-841e-4dcd-acce-f4f014879c87 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.860924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584278-841e-4dcd-acce-f4f014879c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.880229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b8584278-841e-4dcd-acce-f4f014879c87 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:32.881712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b8584278-841e-4dcd-acce-f4f014879c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.890171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 697/1373] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:33.194328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc7d2-5943-44d4-80e2-4ee5682a93f5 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.194611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc7d2-5943-44d4-80e2-4ee5682a93f5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.194981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc7d2-5943-44d4-80e2-4ee5682a93f5 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.196576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 677/1374] 10.222.0.58 () {54 vars in 963 bytes} [Mon May 16 17:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:33.201933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520914-d3b6-4579-8d89-478456b726c4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.202484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520914-d3b6-4579-8d89-478456b726c4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.203034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520914-d3b6-4579-8d89-478456b726c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.252565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-92520914-d3b6-4579-8d89-478456b726c4 None None] MFA Rules not processed for user `0a0ca8aafef94f3399c92a91f5bff1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:33.253770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-92520914-d3b6-4579-8d89-478456b726c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:33.313273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 698/1375] 10.222.0.58 () {58 vars in 1060 bytes} [Mon May 16 17:32:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:33.320988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdc7d2-5943-44d4-80e2-4ee5682a93f5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:33.331727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdc7d2-5943-44d4-80e2-4ee5682a93f5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.335216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acc7b1-e9f6-4dcd-91a2-d28085b9d2a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.335848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acc7b1-e9f6-4dcd-91a2-d28085b9d2a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.336120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acc7b1-e9f6-4dcd-91a2-d28085b9d2a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.336384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acc7b1-e9f6-4dcd-91a2-d28085b9d2a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.345360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acc7b1-e9f6-4dcd-91a2-d28085b9d2a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.346801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acc7b1-e9f6-4dcd-91a2-d28085b9d2a4 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.356023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 678/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:34.861129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bcd92-229b-46d6-8cd7-037b308cf8a0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.863633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bcd92-229b-46d6-8cd7-037b308cf8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.863633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bcd92-229b-46d6-8cd7-037b308cf8a0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.863633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 699/1377] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:34.873014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e739596-ffc5-4593-bf48-816e91defcc8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.873677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e739596-ffc5-4593-bf48-816e91defcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.873677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e739596-ffc5-4593-bf48-816e91defcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.895506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4e739596-ffc5-4593-bf48-816e91defcc8 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:34.896721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4e739596-ffc5-4593-bf48-816e91defcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:34.906341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 679/1378] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:34.951020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bcd92-229b-46d6-8cd7-037b308cf8a0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:34.965851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bcd92-229b-46d6-8cd7-037b308cf8a0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:34.972372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac26f7-97ba-4286-b701-37373df89ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:34.973169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac26f7-97ba-4286-b701-37373df89ed4 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.973454 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac26f7-97ba-4286-b701-37373df89ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.973767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac26f7-97ba-4286-b701-37373df89ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.983326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac26f7-97ba-4286-b701-37373df89ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:34.985011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac26f7-97ba-4286-b701-37373df89ed4 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:34.996035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 700/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:37.256846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07392d-a1e2-43a1-a793-8d77d3924953 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:37.257414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07392d-a1e2-43a1-a793-8d77d3924953 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:37.257414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07392d-a1e2-43a1-a793-8d77d3924953 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:37.258799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 680/1380] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:37.264544 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d566-4f42-4ff9-a157-eeb8e5e190c4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:37.264982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d566-4f42-4ff9-a157-eeb8e5e190c4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:37.265073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d566-4f42-4ff9-a157-eeb8e5e190c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:37.283738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bf93d566-4f42-4ff9-a157-eeb8e5e190c4 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:37.285013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bf93d566-4f42-4ff9-a157-eeb8e5e190c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:37.293862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 701/1381] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:37.338452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07392d-a1e2-43a1-a793-8d77d3924953 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:37.354509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07392d-a1e2-43a1-a793-8d77d3924953 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:37.360427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1e44e-7e9d-4bf3-bdde-6a9c0e701707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:37.361075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e44e-7e9d-4bf3-bdde-6a9c0e701707 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:37.361352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e44e-7e9d-4bf3-bdde-6a9c0e701707 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:37.361655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e44e-7e9d-4bf3-bdde-6a9c0e701707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:37.370499 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1e44e-7e9d-4bf3-bdde-6a9c0e701707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:37.372077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1e44e-7e9d-4bf3-bdde-6a9c0e701707 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:37.382085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 681/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:39.623044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d1f7-02eb-4db4-b634-12ac87185369 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:39.623652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d1f7-02eb-4db4-b634-12ac87185369 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:39.623652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d1f7-02eb-4db4-b634-12ac87185369 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:39.625254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 702/1383] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:39.633180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e7afe-d202-4720-9cd9-b737e77a7a56 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:39.633669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e7afe-d202-4720-9cd9-b737e77a7a56 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:39.633794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e7afe-d202-4720-9cd9-b737e77a7a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:39.652119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d01e7afe-d202-4720-9cd9-b737e77a7a56 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:39.653339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d01e7afe-d202-4720-9cd9-b737e77a7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:39.662781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 682/1384] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:39.706909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9d1f7-02eb-4db4-b634-12ac87185369 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:39.722848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9d1f7-02eb-4db4-b634-12ac87185369 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:39.728789 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfac4d7-f0d2-494f-8ddb-4204da9b8283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:39.729570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfac4d7-f0d2-494f-8ddb-4204da9b8283 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:39.729939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfac4d7-f0d2-494f-8ddb-4204da9b8283 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:39.730302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfac4d7-f0d2-494f-8ddb-4204da9b8283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:39.739252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfac4d7-f0d2-494f-8ddb-4204da9b8283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:39.740923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfac4d7-f0d2-494f-8ddb-4204da9b8283 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:39.750792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 703/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:41.953367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ee0e-4670-4f21-9f1b-99507a66e3de None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:41.954094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ee0e-4670-4f21-9f1b-99507a66e3de None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:41.954333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ee0e-4670-4f21-9f1b-99507a66e3de None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:41.956617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 683/1386] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:41.964570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38d35-9db4-4386-a5a2-587564cb3798 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:41.965096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38d35-9db4-4386-a5a2-587564cb3798 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:41.965279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38d35-9db4-4386-a5a2-587564cb3798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:41.986984 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-92c38d35-9db4-4386-a5a2-587564cb3798 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:41.988312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-92c38d35-9db4-4386-a5a2-587564cb3798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:41.998847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 704/1387] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:42.042682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68ee0e-4670-4f21-9f1b-99507a66e3de None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:42.059348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68ee0e-4670-4f21-9f1b-99507a66e3de None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:42.065117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601642d-e067-4e0a-9922-d0e2896bd3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:42.065797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601642d-e067-4e0a-9922-d0e2896bd3b5 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:42.066076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601642d-e067-4e0a-9922-d0e2896bd3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:42.066348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601642d-e067-4e0a-9922-d0e2896bd3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:42.074428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601642d-e067-4e0a-9922-d0e2896bd3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:42.076060 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601642d-e067-4e0a-9922-d0e2896bd3b5 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:42.085388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 684/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:44.298022 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9bc7f-513c-4a10-96cf-09917f5fc802 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:44.298623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9bc7f-513c-4a10-96cf-09917f5fc802 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:44.298623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9bc7f-513c-4a10-96cf-09917f5fc802 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:44.299927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 705/1389] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:44.306766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557339-d8b3-41d6-b3fd-36dbda228c35 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:44.307328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557339-d8b3-41d6-b3fd-36dbda228c35 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:44.307328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557339-d8b3-41d6-b3fd-36dbda228c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:44.324861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c3557339-d8b3-41d6-b3fd-36dbda228c35 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:44.326065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c3557339-d8b3-41d6-b3fd-36dbda228c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:44.333962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 685/1390] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:44.377423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9bc7f-513c-4a10-96cf-09917f5fc802 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:44.392578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9bc7f-513c-4a10-96cf-09917f5fc802 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:44.398186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bdfc8-128e-4d96-8fde-3f89fb432ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:44.398839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdfc8-128e-4d96-8fde-3f89fb432ff5 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:44.399061 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdfc8-128e-4d96-8fde-3f89fb432ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:44.399339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdfc8-128e-4d96-8fde-3f89fb432ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:44.408207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bdfc8-128e-4d96-8fde-3f89fb432ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:44.409885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bdfc8-128e-4d96-8fde-3f89fb432ff5 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:44.419147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 706/1391] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:46.724932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634a45a-71f3-427d-8d73-cbb5563b6fcd None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:46.725619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634a45a-71f3-427d-8d73-cbb5563b6fcd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:46.725619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634a45a-71f3-427d-8d73-cbb5563b6fcd None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:46.727144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 686/1392] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:46.732542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77892a-66da-4e4f-b81e-77f1afbfddc9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:46.733011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77892a-66da-4e4f-b81e-77f1afbfddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:46.733130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77892a-66da-4e4f-b81e-77f1afbfddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:46.751215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3f77892a-66da-4e4f-b81e-77f1afbfddc9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:46.752425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3f77892a-66da-4e4f-b81e-77f1afbfddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:46.760668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 707/1393] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:46.803873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634a45a-71f3-427d-8d73-cbb5563b6fcd None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:46.819688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634a45a-71f3-427d-8d73-cbb5563b6fcd None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:46.825637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dd5b3-947c-4c15-95b9-b7f5f5d11f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:46.826293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd5b3-947c-4c15-95b9-b7f5f5d11f8a service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:46.826570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd5b3-947c-4c15-95b9-b7f5f5d11f8a service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:46.826841 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd5b3-947c-4c15-95b9-b7f5f5d11f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:46.835555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dd5b3-947c-4c15-95b9-b7f5f5d11f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:46.837183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dd5b3-947c-4c15-95b9-b7f5f5d11f8a service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:46.846641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 687/1394] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:48.849576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d58d5a-81f3-4d07-8d8e-815508c94bd5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:48.850130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d58d5a-81f3-4d07-8d8e-815508c94bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:48.850237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d58d5a-81f3-4d07-8d8e-815508c94bd5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:48.851780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 708/1395] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:48.857218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c781-1118-44e4-b7f1-09a2acfa099d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:48.857721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c781-1118-44e4-b7f1-09a2acfa099d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:48.857828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c781-1118-44e4-b7f1-09a2acfa099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:48.877131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0230c781-1118-44e4-b7f1-09a2acfa099d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:48.878503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0230c781-1118-44e4-b7f1-09a2acfa099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:48.887081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 688/1396] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:48.949049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e5de-0d5c-4473-a245-db4d8bc81dd1 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:48.949324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e5de-0d5c-4473-a245-db4d8bc81dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:48.949802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e5de-0d5c-4473-a245-db4d8bc81dd1 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:48.951575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 709/1397] 10.222.0.58 () {54 vars in 962 bytes} [Mon May 16 17:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:48.956922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05ddbe-fd09-4369-84ed-458e79dbebed None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:48.957215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05ddbe-fd09-4369-84ed-458e79dbebed None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:48.957493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05ddbe-fd09-4369-84ed-458e79dbebed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.004526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5f05ddbe-fd09-4369-84ed-458e79dbebed None None] MFA Rules not processed for user `43278916b971416e80a79077cf0da75d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:49.005839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5f05ddbe-fd09-4369-84ed-458e79dbebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:49.055598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162225-54fe-4f8c-9b43-a6222b7651cf None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:49.055804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162225-54fe-4f8c-9b43-a6222b7651cf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:49.056091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162225-54fe-4f8c-9b43-a6222b7651cf None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.057941 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 710/1398] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:32:49.063259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6261df-96b0-40d7-ab39-8f2c08e6b306 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:49.063610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6261df-96b0-40d7-ab39-8f2c08e6b306 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:49.063995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6261df-96b0-40d7-ab39-8f2c08e6b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.066717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 689/1399] 10.222.0.58 () {58 vars in 1059 bytes} [Mon May 16 17:32:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:49.074161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05ddbe-fd09-4369-84ed-458e79dbebed None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:49.081651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05ddbe-fd09-4369-84ed-458e79dbebed None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:49.081942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6a6261df-96b0-40d7-ab39-8f2c08e6b306 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:49.083194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6a6261df-96b0-40d7-ab39-8f2c08e6b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:49.085216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18e0e-8f5a-43d8-92ec-fcaa57f32f97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43278916b971416e80a79077cf0da75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:49.085877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18e0e-8f5a-43d8-92ec-fcaa57f32f97 service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:49.086153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18e0e-8f5a-43d8-92ec-fcaa57f32f97 service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:49.086421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18e0e-8f5a-43d8-92ec-fcaa57f32f97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.101619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 711/1400] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:49.101827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de18e0e-8f5a-43d8-92ec-fcaa57f32f97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:49.101827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de18e0e-8f5a-43d8-92ec-fcaa57f32f97 service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:49.106340 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 690/1401] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:32:49.137140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6261df-96b0-40d7-ab39-8f2c08e6b306 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:49.157844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6261df-96b0-40d7-ab39-8f2c08e6b306 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:49.166195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a0a2f-9832-45fa-a623-170ee5582246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:49.166930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a0a2f-9832-45fa-a623-170ee5582246 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:49.167212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a0a2f-9832-45fa-a623-170ee5582246 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:49.167493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a0a2f-9832-45fa-a623-170ee5582246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.176958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a0a2f-9832-45fa-a623-170ee5582246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:49.179678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a0a2f-9832-45fa-a623-170ee5582246 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:49.192857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 712/1402] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:32:49.539101 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa966a-e7f5-4562-ab87-d1134c73abfe None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:49.539389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa966a-e7f5-4562-ab87-d1134c73abfe None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:49.539668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa966a-e7f5-4562-ab87-d1134c73abfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.589884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-28fa966a-e7f5-4562-ab87-d1134c73abfe None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:49.591097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-28fa966a-e7f5-4562-ab87-d1134c73abfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:49.656231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 691/1403] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:32:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:49.703863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435574-89b7-44da-8c85-428280d453c8 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:49.704230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435574-89b7-44da-8c85-428280d453c8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:49.704571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435574-89b7-44da-8c85-428280d453c8 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.706075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 713/1404] 10.222.0.58 () {54 vars in 942 bytes} [Mon May 16 17:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:49.712585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d150e-bd89-4a2b-be7f-e1edc9a45cc6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:49.712873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d150e-bd89-4a2b-be7f-e1edc9a45cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:49.713144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d150e-bd89-4a2b-be7f-e1edc9a45cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.763224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bb0d150e-bd89-4a2b-be7f-e1edc9a45cc6 None None] MFA Rules not processed for user `6f320795fd0b42319df94dbc171938b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:49.764380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bb0d150e-bd89-4a2b-be7f-e1edc9a45cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:49.838814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 692/1405] 10.222.0.58 () {58 vars in 1039 bytes} [Mon May 16 17:32:49 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:49.848135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d435574-89b7-44da-8c85-428280d453c8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:49.862609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d435574-89b7-44da-8c85-428280d453c8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:49.868414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b49b4e-c70c-4137-88b7-19bdfd30de90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:49.869183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49b4e-c70c-4137-88b7-19bdfd30de90 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:49.869530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49b4e-c70c-4137-88b7-19bdfd30de90 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:49.869906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49b4e-c70c-4137-88b7-19bdfd30de90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:49.878198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b49b4e-c70c-4137-88b7-19bdfd30de90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:49.879866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b49b4e-c70c-4137-88b7-19bdfd30de90 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:49.888099 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 714/1406] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:32:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:32:51.427852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984965bd-5c26-4234-9667-dcfe233898e8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.428379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984965bd-5c26-4234-9667-dcfe233898e8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.428379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984965bd-5c26-4234-9667-dcfe233898e8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.430110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 693/1407] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:32:51.435255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e728f-afd0-4d07-9465-e26fdeeb60a7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.436097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e728f-afd0-4d07-9465-e26fdeeb60a7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.436576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e728f-afd0-4d07-9465-e26fdeeb60a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.455024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-071e728f-afd0-4d07-9465-e26fdeeb60a7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:51.456600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-071e728f-afd0-4d07-9465-e26fdeeb60a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:51.464341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 715/1408] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:51.511412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984965bd-5c26-4234-9667-dcfe233898e8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:51.530521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984965bd-5c26-4234-9667-dcfe233898e8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:51.536218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f9232-f694-4dcb-b348-f957b914841c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:51.537011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9232-f694-4dcb-b348-f957b914841c service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.537301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9232-f694-4dcb-b348-f957b914841c service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.537605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9232-f694-4dcb-b348-f957b914841c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.546468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f9232-f694-4dcb-b348-f957b914841c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:51.548389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f9232-f694-4dcb-b348-f957b914841c service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:51.569881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 694/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:13.039028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb55f-bf45-4632-9178-79f3086c448e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:13.039677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb55f-bf45-4632-9178-79f3086c448e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:13.039677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb55f-bf45-4632-9178-79f3086c448e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:13.040925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 716/1410] 10.222.0.58 () {54 vars in 918 bytes} [Mon May 16 17:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:13.047508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04b09a-16c7-42b9-be9f-882e1de06a45 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:13.047979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04b09a-16c7-42b9-be9f-882e1de06a45 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:13.048082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04b09a-16c7-42b9-be9f-882e1de06a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:13.067144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0f04b09a-16c7-42b9-be9f-882e1de06a45 None None] MFA Rules not processed for user `02938c77178a4f14a33ff1298775687c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:13.068270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0f04b09a-16c7-42b9-be9f-882e1de06a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:13.077974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 695/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Mon May 16 17:33:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:13.092361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9e33-d7b7-43a3-9a8a-192a9e034408 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:13.092643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9e33-d7b7-43a3-9a8a-192a9e034408 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:13.092916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9e33-d7b7-43a3-9a8a-192a9e034408 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:13.094293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 717/1412] 10.222.0.58 () {54 vars in 918 bytes} [Mon May 16 17:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:13.099194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7a3a6-0de4-44b2-84e4-fb0554529bcc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:13.099550 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7a3a6-0de4-44b2-84e4-fb0554529bcc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:13.099859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7a3a6-0de4-44b2-84e4-fb0554529bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:13.119994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-80e7a3a6-0de4-44b2-84e4-fb0554529bcc None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:13.121338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-80e7a3a6-0de4-44b2-84e4-fb0554529bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:13.132898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 696/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Mon May 16 17:33:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:15.783882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15f1b-6e7b-4a04-bc93-332319154c8c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:15.784500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15f1b-6e7b-4a04-bc93-332319154c8c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:15.784500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15f1b-6e7b-4a04-bc93-332319154c8c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:15.785808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:15.792262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0a23-a30f-4940-96a9-8f87c7d93813 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:15.792988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0a23-a30f-4940-96a9-8f87c7d93813 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:15.793171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0a23-a30f-4940-96a9-8f87c7d93813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:15.813285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-607e0a23-a30f-4940-96a9-8f87c7d93813 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:15.814486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-607e0a23-a30f-4940-96a9-8f87c7d93813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:15.822839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:15.865343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15f1b-6e7b-4a04-bc93-332319154c8c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:15.879420 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15f1b-6e7b-4a04-bc93-332319154c8c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:15.885245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128c047-c487-483f-a3b6-90f1de04b6d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:15.885922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c047-c487-483f-a3b6-90f1de04b6d3 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:15.886194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c047-c487-483f-a3b6-90f1de04b6d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:15.886460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c047-c487-483f-a3b6-90f1de04b6d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:15.894572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128c047-c487-483f-a3b6-90f1de04b6d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:15.896133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128c047-c487-483f-a3b6-90f1de04b6d3 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:15.905267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 719/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:16.910867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6213619-adfe-4b2d-90c6-385fc8696499 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:16.911749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6213619-adfe-4b2d-90c6-385fc8696499 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:16.911749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6213619-adfe-4b2d-90c6-385fc8696499 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:16.914029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:33:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:16.919335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263abfb-932e-4264-97ac-37e96e46cb65 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:16.919764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263abfb-932e-4264-97ac-37e96e46cb65 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:16.919876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263abfb-932e-4264-97ac-37e96e46cb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:16.945151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6263abfb-932e-4264-97ac-37e96e46cb65 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:16.946367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6263abfb-932e-4264-97ac-37e96e46cb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:16.955733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:17.117367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6213619-adfe-4b2d-90c6-385fc8696499 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:17.137894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6213619-adfe-4b2d-90c6-385fc8696499 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:17.146641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2dbc7-438f-4763-be85-d497abcaad33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:17.147261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dbc7-438f-4763-be85-d497abcaad33 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:17.147535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dbc7-438f-4763-be85-d497abcaad33 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:17.147800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2dbc7-438f-4763-be85-d497abcaad33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:17.157243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2dbc7-438f-4763-be85-d497abcaad33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:17.158894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2dbc7-438f-4763-be85-d497abcaad33 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:17.168210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 699/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:18.122969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e5dd-4ccc-475b-9135-cf0bd6a352f9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:18.123572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e5dd-4ccc-475b-9135-cf0bd6a352f9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:18.123572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e5dd-4ccc-475b-9135-cf0bd6a352f9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:18.125570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:33:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:18.130956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c1d97-3da0-4157-8d44-16ff37a9dd88 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:18.131442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c1d97-3da0-4157-8d44-16ff37a9dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:18.131442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c1d97-3da0-4157-8d44-16ff37a9dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:18.155720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c68c1d97-3da0-4157-8d44-16ff37a9dd88 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:18.156924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c68c1d97-3da0-4157-8d44-16ff37a9dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:18.166649 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:18.321729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617e5dd-4ccc-475b-9135-cf0bd6a352f9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:18.339291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617e5dd-4ccc-475b-9135-cf0bd6a352f9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:18.346230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ee2f0-67dd-47c2-a9ea-ac0194d1b62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:18.346861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ee2f0-67dd-47c2-a9ea-ac0194d1b62f service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:18.347136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ee2f0-67dd-47c2-a9ea-ac0194d1b62f service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:18.347404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ee2f0-67dd-47c2-a9ea-ac0194d1b62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:18.355611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ee2f0-67dd-47c2-a9ea-ac0194d1b62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:18.357196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ee2f0-67dd-47c2-a9ea-ac0194d1b62f service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:18.370317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 722/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:19.291773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17e01-764f-4a28-828e-66dfa69170f5 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:19.292406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17e01-764f-4a28-828e-66dfa69170f5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:19.292406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17e01-764f-4a28-828e-66dfa69170f5 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:19.294267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:19.299763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50b78-cea2-440c-8538-ee3b7c954dfb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:19.300223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50b78-cea2-440c-8538-ee3b7c954dfb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:19.300341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50b78-cea2-440c-8538-ee3b7c954dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:19.318458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3ad50b78-cea2-440c-8538-ee3b7c954dfb None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:19.319620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3ad50b78-cea2-440c-8538-ee3b7c954dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:19.327772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:33:19.472984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b17e01-764f-4a28-828e-66dfa69170f5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:19.489299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b17e01-764f-4a28-828e-66dfa69170f5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:19.496119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f022c-b0fe-4b47-b9ca-017e686db6e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:19.496754 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f022c-b0fe-4b47-b9ca-017e686db6e3 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:19.497019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f022c-b0fe-4b47-b9ca-017e686db6e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:19.497285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f022c-b0fe-4b47-b9ca-017e686db6e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:19.505768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f022c-b0fe-4b47-b9ca-017e686db6e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:19.507332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f022c-b0fe-4b47-b9ca-017e686db6e3 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:19.516559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 702/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:20.438337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2de7c-b0c1-46bb-b8ad-4866172e0806 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:20.439213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2de7c-b0c1-46bb-b8ad-4866172e0806 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:20.439353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2de7c-b0c1-46bb-b8ad-4866172e0806 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:20.441609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:33:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:20.447771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2662d-1c67-4b98-b052-29d8f1be5b8d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:20.448466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2662d-1c67-4b98-b052-29d8f1be5b8d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:20.448575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2662d-1c67-4b98-b052-29d8f1be5b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:20.469529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-36f2662d-1c67-4b98-b052-29d8f1be5b8d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:20.470643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-36f2662d-1c67-4b98-b052-29d8f1be5b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:20.479901 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:20.627130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2de7c-b0c1-46bb-b8ad-4866172e0806 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:20.642540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2de7c-b0c1-46bb-b8ad-4866172e0806 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:20.648108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bb026-06ee-4cd7-b5ca-c609db8aa52a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:20.648730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb026-06ee-4cd7-b5ca-c609db8aa52a service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:20.649031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb026-06ee-4cd7-b5ca-c609db8aa52a service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:20.649295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb026-06ee-4cd7-b5ca-c609db8aa52a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:20.657286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bb026-06ee-4cd7-b5ca-c609db8aa52a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:20.658898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bb026-06ee-4cd7-b5ca-c609db8aa52a service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:20.670032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 725/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:21.543906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a556c6-bf48-421e-9912-a107b0d1ac8e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:21.544495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a556c6-bf48-421e-9912-a107b0d1ac8e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:21.544495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a556c6-bf48-421e-9912-a107b0d1ac8e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:21.545888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:21.551435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a18f2-4743-4048-b4fe-944d6a0f715a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:21.551882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a18f2-4743-4048-b4fe-944d6a0f715a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:21.551994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a18f2-4743-4048-b4fe-944d6a0f715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:21.572172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-677a18f2-4743-4048-b4fe-944d6a0f715a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:21.573339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-677a18f2-4743-4048-b4fe-944d6a0f715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:21.582399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:21.733207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a556c6-bf48-421e-9912-a107b0d1ac8e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:21.755218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a556c6-bf48-421e-9912-a107b0d1ac8e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:21.761857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7cca4-5e0c-44c7-93df-c7d85d178aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:21.762496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7cca4-5e0c-44c7-93df-c7d85d178aa0 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:21.762773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7cca4-5e0c-44c7-93df-c7d85d178aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:21.763043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7cca4-5e0c-44c7-93df-c7d85d178aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:21.771127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7cca4-5e0c-44c7-93df-c7d85d178aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:21.772699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7cca4-5e0c-44c7-93df-c7d85d178aa0 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:21.782081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 705/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:22.656181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e3e7-09e8-41f9-b9d5-9656c04eb14b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:22.657055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e3e7-09e8-41f9-b9d5-9656c04eb14b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:22.657055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e3e7-09e8-41f9-b9d5-9656c04eb14b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:22.659258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:33:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:22.664596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c329c-f9bd-45e1-84ba-f1a5c3ff60c1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:22.665042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c329c-f9bd-45e1-84ba-f1a5c3ff60c1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:22.665137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c329c-f9bd-45e1-84ba-f1a5c3ff60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:22.684168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2e9c329c-f9bd-45e1-84ba-f1a5c3ff60c1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:22.685371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2e9c329c-f9bd-45e1-84ba-f1a5c3ff60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:22.693622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:22.840971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e3e7-09e8-41f9-b9d5-9656c04eb14b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:22.862740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e3e7-09e8-41f9-b9d5-9656c04eb14b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:22.869503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff206b7-4f6a-4d74-80f8-90593aa626dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:22.870284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff206b7-4f6a-4d74-80f8-90593aa626dc service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:22.870567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff206b7-4f6a-4d74-80f8-90593aa626dc service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:22.870840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff206b7-4f6a-4d74-80f8-90593aa626dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:22.879526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff206b7-4f6a-4d74-80f8-90593aa626dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:22.881125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff206b7-4f6a-4d74-80f8-90593aa626dc service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:22.891021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 728/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:23.766107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd1d0-1af3-439f-a35d-a9523e45653b None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:23.767036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd1d0-1af3-439f-a35d-a9523e45653b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:23.767036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd1d0-1af3-439f-a35d-a9523e45653b None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:23.769140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:33:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:23.775238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecbee6-1fe2-4ba2-8785-3643f8abd8a6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:23.775716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecbee6-1fe2-4ba2-8785-3643f8abd8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:23.775881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecbee6-1fe2-4ba2-8785-3643f8abd8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:23.796554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d6ecbee6-1fe2-4ba2-8785-3643f8abd8a6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:23.798103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d6ecbee6-1fe2-4ba2-8785-3643f8abd8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:23.806837 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:23.970220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd1d0-1af3-439f-a35d-a9523e45653b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:23.986974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd1d0-1af3-439f-a35d-a9523e45653b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:23.993148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49a7e6-b0d9-4170-a335-232c906e044c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:23.993928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a7e6-b0d9-4170-a335-232c906e044c service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:23.994237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a7e6-b0d9-4170-a335-232c906e044c service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:23.994510 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a7e6-b0d9-4170-a335-232c906e044c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:24.003000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49a7e6-b0d9-4170-a335-232c906e044c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:24.004606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49a7e6-b0d9-4170-a335-232c906e044c service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:24.013925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 708/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:24.878078 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e4d8-171b-4277-b94c-1dbb60dce382 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:24.878636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e4d8-171b-4277-b94c-1dbb60dce382 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:24.878636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e4d8-171b-4277-b94c-1dbb60dce382 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:24.880045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:24.885153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf50bf2-e170-4523-aad6-6f4b5d7803c5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:24.885587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf50bf2-e170-4523-aad6-6f4b5d7803c5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:24.885761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf50bf2-e170-4523-aad6-6f4b5d7803c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:24.903640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bbf50bf2-e170-4523-aad6-6f4b5d7803c5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:24.904813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bbf50bf2-e170-4523-aad6-6f4b5d7803c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:24.913111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:25.061898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8e4d8-171b-4277-b94c-1dbb60dce382 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:25.084103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8e4d8-171b-4277-b94c-1dbb60dce382 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:25.091177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516112d8-e1c4-4f6e-b7bf-3f6efdb1c01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:25.091804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516112d8-e1c4-4f6e-b7bf-3f6efdb1c01c service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:25.092081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516112d8-e1c4-4f6e-b7bf-3f6efdb1c01c service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:25.092348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516112d8-e1c4-4f6e-b7bf-3f6efdb1c01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:25.100706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516112d8-e1c4-4f6e-b7bf-3f6efdb1c01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:25.102347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516112d8-e1c4-4f6e-b7bf-3f6efdb1c01c service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:25.114296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 731/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:27.167557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750143-8755-4ed1-85f8-8d7117308bed None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:27.168442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750143-8755-4ed1-85f8-8d7117308bed None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:27.168442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750143-8755-4ed1-85f8-8d7117308bed None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:27.170620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:27.176954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ae1c-4129-49a1-a088-6f7bff05a51b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:27.177399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ae1c-4129-49a1-a088-6f7bff05a51b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:27.177494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ae1c-4129-49a1-a088-6f7bff05a51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:27.199914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fe96ae1c-4129-49a1-a088-6f7bff05a51b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:27.201734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fe96ae1c-4129-49a1-a088-6f7bff05a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:27.210884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:27.253671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750143-8755-4ed1-85f8-8d7117308bed None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:27.265861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750143-8755-4ed1-85f8-8d7117308bed None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:27.269729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b259a8-e1f7-49c8-989b-d695c638f1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:27.270376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b259a8-e1f7-49c8-989b-d695c638f1db service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:27.270652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b259a8-e1f7-49c8-989b-d695c638f1db service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:27.270918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b259a8-e1f7-49c8-989b-d695c638f1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:27.279550 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b259a8-e1f7-49c8-989b-d695c638f1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:27.280965 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b259a8-e1f7-49c8-989b-d695c638f1db service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:27.289927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 711/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:29.607858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789cba-23bf-4560-bb5c-c77dd4f0ddcc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:29.608450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789cba-23bf-4560-bb5c-c77dd4f0ddcc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:29.608450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789cba-23bf-4560-bb5c-c77dd4f0ddcc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:29.610192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:29.615768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0608-7321-4d7c-bbec-195ca4437eb0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:29.616246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0608-7321-4d7c-bbec-195ca4437eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:29.616246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0608-7321-4d7c-bbec-195ca4437eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:29.635572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-be7b0608-7321-4d7c-bbec-195ca4437eb0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:29.636730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-be7b0608-7321-4d7c-bbec-195ca4437eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:29.645022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:33:29.684917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789cba-23bf-4560-bb5c-c77dd4f0ddcc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:29.698127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789cba-23bf-4560-bb5c-c77dd4f0ddcc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:29.702247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c27e4-8649-44f6-9417-744eb549398b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:29.702918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c27e4-8649-44f6-9417-744eb549398b service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:29.703217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c27e4-8649-44f6-9417-744eb549398b service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:29.703479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c27e4-8649-44f6-9417-744eb549398b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:29.713197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c27e4-8649-44f6-9417-744eb549398b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:29.714649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c27e4-8649-44f6-9417-744eb549398b service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:29.724549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 734/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:32.245951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00808f2-31c9-420e-8800-f2807a84a4ff None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:32.246488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00808f2-31c9-420e-8800-f2807a84a4ff None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:32.246488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00808f2-31c9-420e-8800-f2807a84a4ff None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:32.247900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:32.253512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c1373-c3d3-4a86-bb0b-48b3453eac27 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:32.253975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c1373-c3d3-4a86-bb0b-48b3453eac27 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:32.254068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c1373-c3d3-4a86-bb0b-48b3453eac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:32.274054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-400c1373-c3d3-4a86-bb0b-48b3453eac27 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:32.275259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-400c1373-c3d3-4a86-bb0b-48b3453eac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:32.287271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:32.328728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00808f2-31c9-420e-8800-f2807a84a4ff None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:32.340872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00808f2-31c9-420e-8800-f2807a84a4ff None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:32.345495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf410119-3203-4875-8797-c69ce6126ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:32.346428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf410119-3203-4875-8797-c69ce6126ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:32.346703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf410119-3203-4875-8797-c69ce6126ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:32.346968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf410119-3203-4875-8797-c69ce6126ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:32.356400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf410119-3203-4875-8797-c69ce6126ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:32.357854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf410119-3203-4875-8797-c69ce6126ce3 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:32.369276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 714/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:34.787840 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d7dca-3538-48a5-a50a-08755b667a38 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:34.788478 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d7dca-3538-48a5-a50a-08755b667a38 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:34.788478 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d7dca-3538-48a5-a50a-08755b667a38 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:34.790706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:34.799023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06765ba8-5f57-4cd1-91e5-ca29890c89fd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:34.799497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06765ba8-5f57-4cd1-91e5-ca29890c89fd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:34.799611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06765ba8-5f57-4cd1-91e5-ca29890c89fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:34.817733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-06765ba8-5f57-4cd1-91e5-ca29890c89fd None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:34.818898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-06765ba8-5f57-4cd1-91e5-ca29890c89fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:34.827983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:33:34.867149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d7dca-3538-48a5-a50a-08755b667a38 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:34.878707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d7dca-3538-48a5-a50a-08755b667a38 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:34.882889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e73c56-cb7b-47ca-9632-fcb9bcd91d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:34.883532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e73c56-cb7b-47ca-9632-fcb9bcd91d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:34.883814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e73c56-cb7b-47ca-9632-fcb9bcd91d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:34.884090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e73c56-cb7b-47ca-9632-fcb9bcd91d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:34.893473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e73c56-cb7b-47ca-9632-fcb9bcd91d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:34.894977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e73c56-cb7b-47ca-9632-fcb9bcd91d3f service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:34.904581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 737/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:37.318240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875e21-2c3c-47d1-b202-05a4a849d015 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:37.319124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875e21-2c3c-47d1-b202-05a4a849d015 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:37.319124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875e21-2c3c-47d1-b202-05a4a849d015 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:37.321028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:37.329917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbcd38-6f6f-41e4-8ba2-36ba33380a64 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:37.330353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbcd38-6f6f-41e4-8ba2-36ba33380a64 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:37.330479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbcd38-6f6f-41e4-8ba2-36ba33380a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:37.353962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9bdbcd38-6f6f-41e4-8ba2-36ba33380a64 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:37.355153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9bdbcd38-6f6f-41e4-8ba2-36ba33380a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:37.363368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:37.403367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875e21-2c3c-47d1-b202-05a4a849d015 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:37.416321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875e21-2c3c-47d1-b202-05a4a849d015 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:37.420671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8714ba2-bbc8-449c-ac90-234773660be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:37.421310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8714ba2-bbc8-449c-ac90-234773660be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:37.421613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8714ba2-bbc8-449c-ac90-234773660be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:37.421886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8714ba2-bbc8-449c-ac90-234773660be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:37.431234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8714ba2-bbc8-449c-ac90-234773660be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:37.432661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8714ba2-bbc8-449c-ac90-234773660be1 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:37.442054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 717/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:39.674317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba7c39-2698-4bd7-86a0-efa4fe8a2032 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:39.675215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba7c39-2698-4bd7-86a0-efa4fe8a2032 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:39.675215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba7c39-2698-4bd7-86a0-efa4fe8a2032 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:39.677384 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:39.686316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cfe34-b93b-4e63-95f1-18682e1c524c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:39.687116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cfe34-b93b-4e63-95f1-18682e1c524c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:39.687285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cfe34-b93b-4e63-95f1-18682e1c524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:39.705356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-665cfe34-b93b-4e63-95f1-18682e1c524c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:39.706537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-665cfe34-b93b-4e63-95f1-18682e1c524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:39.715223 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:39.752318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba7c39-2698-4bd7-86a0-efa4fe8a2032 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:39.764769 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba7c39-2698-4bd7-86a0-efa4fe8a2032 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:39.768672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefeefca-2c64-4dad-b583-2615ad11f6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:39.769300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeefca-2c64-4dad-b583-2615ad11f6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:39.769580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeefca-2c64-4dad-b583-2615ad11f6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:39.769862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeefca-2c64-4dad-b583-2615ad11f6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:39.778715 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefeefca-2c64-4dad-b583-2615ad11f6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:39.780144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefeefca-2c64-4dad-b583-2615ad11f6f0 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:39.789783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 740/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:42.032892 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98b4b-3a84-4e3c-a091-683e28c01442 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:42.033463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98b4b-3a84-4e3c-a091-683e28c01442 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:42.033463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf98b4b-3a84-4e3c-a091-683e28c01442 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:42.034853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:42.043755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5adf6-c7c8-47f7-afe4-fa8cc5f0d6d5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:42.044444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5adf6-c7c8-47f7-afe4-fa8cc5f0d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:42.044636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5adf6-c7c8-47f7-afe4-fa8cc5f0d6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:42.064131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9cc5adf6-c7c8-47f7-afe4-fa8cc5f0d6d5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:42.065316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9cc5adf6-c7c8-47f7-afe4-fa8cc5f0d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:42.074228 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:42.111652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf98b4b-3a84-4e3c-a091-683e28c01442 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:42.132577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf98b4b-3a84-4e3c-a091-683e28c01442 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:42.138447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b4b76-bd64-4a97-84b8-6e6733babd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:42.139313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4b76-bd64-4a97-84b8-6e6733babd8f service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:42.139593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4b76-bd64-4a97-84b8-6e6733babd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:42.139877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4b76-bd64-4a97-84b8-6e6733babd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:42.150338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b4b76-bd64-4a97-84b8-6e6733babd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:42.151764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b4b76-bd64-4a97-84b8-6e6733babd8f service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:42.161731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 720/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:44.396881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeefdd1-4fed-4e03-8a5d-6d47acdbf68d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:44.397476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeefdd1-4fed-4e03-8a5d-6d47acdbf68d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:44.397476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeefdd1-4fed-4e03-8a5d-6d47acdbf68d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:44.398849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:44.405319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc560ac-aed0-4bda-b6c5-90444208399e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:44.406112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc560ac-aed0-4bda-b6c5-90444208399e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:44.406287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc560ac-aed0-4bda-b6c5-90444208399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:44.431039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7dc560ac-aed0-4bda-b6c5-90444208399e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:44.432220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7dc560ac-aed0-4bda-b6c5-90444208399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:44.440971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:44.477711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeefdd1-4fed-4e03-8a5d-6d47acdbf68d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:44.489216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeefdd1-4fed-4e03-8a5d-6d47acdbf68d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:44.493392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775981d-c717-49ec-b64e-c7230fc76af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:44.494070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775981d-c717-49ec-b64e-c7230fc76af9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:44.494344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775981d-c717-49ec-b64e-c7230fc76af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:44.494617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775981d-c717-49ec-b64e-c7230fc76af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:44.504529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775981d-c717-49ec-b64e-c7230fc76af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:44.506000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775981d-c717-49ec-b64e-c7230fc76af9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:44.515817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 743/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:33:46.718586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351ba9-ba25-422f-a135-ce790bffc1ab None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:46.719159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351ba9-ba25-422f-a135-ce790bffc1ab None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:46.719159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351ba9-ba25-422f-a135-ce790bffc1ab None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:46.720504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:46.727119 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c74100-5eae-4436-b59d-ddb2300363a1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:46.727874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c74100-5eae-4436-b59d-ddb2300363a1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:46.728027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c74100-5eae-4436-b59d-ddb2300363a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:46.750011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d3c74100-5eae-4436-b59d-ddb2300363a1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:46.751206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d3c74100-5eae-4436-b59d-ddb2300363a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:46.760217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:46.796184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351ba9-ba25-422f-a135-ce790bffc1ab None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:46.809086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351ba9-ba25-422f-a135-ce790bffc1ab None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:46.813272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c5123-73d4-473b-96b3-7a6cefff9609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:46.813936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c5123-73d4-473b-96b3-7a6cefff9609 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:46.814207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c5123-73d4-473b-96b3-7a6cefff9609 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:46.814459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c5123-73d4-473b-96b3-7a6cefff9609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:46.824058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c5123-73d4-473b-96b3-7a6cefff9609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:46.825682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c5123-73d4-473b-96b3-7a6cefff9609 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:46.837673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 723/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:49.046933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f9c2-18c6-4dfb-be93-9ddfb1fdf495 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:49.047877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f9c2-18c6-4dfb-be93-9ddfb1fdf495 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:49.047877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f9c2-18c6-4dfb-be93-9ddfb1fdf495 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:49.050064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:33:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:33:49.058573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cbfe0-cf8c-4b73-801f-a35281f18033 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:49.059181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cbfe0-cf8c-4b73-801f-a35281f18033 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:49.059181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cbfe0-cf8c-4b73-801f-a35281f18033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:49.083369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b20cbfe0-cf8c-4b73-801f-a35281f18033 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:49.084473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b20cbfe0-cf8c-4b73-801f-a35281f18033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:49.091979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:49.130967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f9c2-18c6-4dfb-be93-9ddfb1fdf495 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:49.146582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f9c2-18c6-4dfb-be93-9ddfb1fdf495 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:49.152885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741db74-9be6-4b75-ae79-02e468b14fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:49.153848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741db74-9be6-4b75-ae79-02e468b14fac service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:49.154201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741db74-9be6-4b75-ae79-02e468b14fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:49.154520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741db74-9be6-4b75-ae79-02e468b14fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:49.164483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741db74-9be6-4b75-ae79-02e468b14fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:49.165973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741db74-9be6-4b75-ae79-02e468b14fac service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:49.175485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 746/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:34:21.969478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4575a-701e-4384-a865-bcd812b7dec6 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:21.970144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4575a-701e-4384-a865-bcd812b7dec6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:21.970144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4575a-701e-4384-a865-bcd812b7dec6 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:21.971414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 725/1471] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:34:21.977814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a49c3-48cd-449d-83c8-c0dd79ac65f3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:21.978287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a49c3-48cd-449d-83c8-c0dd79ac65f3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:21.978413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a49c3-48cd-449d-83c8-c0dd79ac65f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:22.007407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-057a49c3-48cd-449d-83c8-c0dd79ac65f3 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:34:22.009246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-057a49c3-48cd-449d-83c8-c0dd79ac65f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:34:22.019572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 747/1472] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:34:22.075876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a20e-884f-4ebe-a100-324a7505dd2a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:22.076155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a20e-884f-4ebe-a100-324a7505dd2a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:22.076424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a20e-884f-4ebe-a100-324a7505dd2a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:22.077945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 726/1473] 10.222.0.58 () {54 vars in 962 bytes} [Mon May 16 17:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:34:22.082915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1dcf3-6bbb-428f-a43d-162a93a918ce None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:22.083206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1dcf3-6bbb-428f-a43d-162a93a918ce None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:22.083484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1dcf3-6bbb-428f-a43d-162a93a918ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:22.102415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-32e1dcf3-6bbb-428f-a43d-162a93a918ce None None] MFA Rules not processed for user `43278916b971416e80a79077cf0da75d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:34:22.103608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-32e1dcf3-6bbb-428f-a43d-162a93a918ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:34:22.111376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 748/1474] 10.222.0.58 () {58 vars in 1059 bytes} [Mon May 16 17:34:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:34:22.118848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20a20e-884f-4ebe-a100-324a7505dd2a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:34:22.129994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20a20e-884f-4ebe-a100-324a7505dd2a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:34:22.133908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b6001-5720-44b5-a3ad-76e6f38bea8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43278916b971416e80a79077cf0da75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:34:22.134531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6001-5720-44b5-a3ad-76e6f38bea8d service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:22.134809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6001-5720-44b5-a3ad-76e6f38bea8d service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:22.135087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6001-5720-44b5-a3ad-76e6f38bea8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:22.145004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b6001-5720-44b5-a3ad-76e6f38bea8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:34:22.146458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b6001-5720-44b5-a3ad-76e6f38bea8d service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:34:22.156364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 727/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:34:24.434008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca0239-ac87-482f-8539-bd705e3f8c4b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:24.434613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca0239-ac87-482f-8539-bd705e3f8c4b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:24.434613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca0239-ac87-482f-8539-bd705e3f8c4b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:24.435906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 749/1476] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:34:24.442237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee023-83f7-4030-a47f-a29721991533 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:24.442824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee023-83f7-4030-a47f-a29721991533 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:24.442933 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee023-83f7-4030-a47f-a29721991533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:24.467190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-13eee023-83f7-4030-a47f-a29721991533 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:34:24.468589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-13eee023-83f7-4030-a47f-a29721991533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:34:24.476513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 728/1477] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:34:24.500169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca0239-ac87-482f-8539-bd705e3f8c4b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:34:24.520274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca0239-ac87-482f-8539-bd705e3f8c4b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:34:24.528068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fb687-43be-4f74-84f6-79cfb8cb4bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:34:24.529071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb687-43be-4f74-84f6-79cfb8cb4bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:24.529513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb687-43be-4f74-84f6-79cfb8cb4bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:24.530000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb687-43be-4f74-84f6-79cfb8cb4bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:24.530917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fb687-43be-4f74-84f6-79cfb8cb4bf5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:34:24.532651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-437fb687-43be-4f74-84f6-79cfb8cb4bf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:34:24.532651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 16 17:34:24.532651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: May 16 17:34:24.533811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fb687-43be-4f74-84f6-79cfb8cb4bf5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:34:24.552583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 750/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Mon May 16 17:34:24 2022] GET /identity/v3/projects => generated 2553 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:34:26.751210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f018-0664-4835-a7fa-6759150eb57f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:26.752080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f018-0664-4835-a7fa-6759150eb57f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:26.752080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f018-0664-4835-a7fa-6759150eb57f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:26.754269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 729/1479] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:34:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:34:26.759815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90774b4b-7e66-4fd2-b5ff-4a8b07130290 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:26.760286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90774b4b-7e66-4fd2-b5ff-4a8b07130290 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:26.760395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90774b4b-7e66-4fd2-b5ff-4a8b07130290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:26.780201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-90774b4b-7e66-4fd2-b5ff-4a8b07130290 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:34:26.781375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-90774b4b-7e66-4fd2-b5ff-4a8b07130290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:34:26.789659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 751/1480] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:34:26.840684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f018-0664-4835-a7fa-6759150eb57f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:34:26.857808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f018-0664-4835-a7fa-6759150eb57f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:34:26.863861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46af20-1cf0-4c21-9ba4-5ee2c566e5a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:34:26.864493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46af20-1cf0-4c21-9ba4-5ee2c566e5a9 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:26.864768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46af20-1cf0-4c21-9ba4-5ee2c566e5a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:26.865038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46af20-1cf0-4c21-9ba4-5ee2c566e5a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:26.874037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46af20-1cf0-4c21-9ba4-5ee2c566e5a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:34:26.875600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46af20-1cf0-4c21-9ba4-5ee2c566e5a9 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:34:26.884867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 730/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:34:29.282888 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286bce-7da0-4afc-bb69-0251e66314f3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:29.283459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286bce-7da0-4afc-bb69-0251e66314f3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:29.283459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286bce-7da0-4afc-bb69-0251e66314f3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:29.284799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 752/1482] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:34:29.291178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d17a1-c57e-43f8-a4fb-6336366d5a17 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:29.291620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d17a1-c57e-43f8-a4fb-6336366d5a17 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:29.291847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d17a1-c57e-43f8-a4fb-6336366d5a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:29.312104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d59d17a1-c57e-43f8-a4fb-6336366d5a17 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:34:29.313288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d59d17a1-c57e-43f8-a4fb-6336366d5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:34:29.322739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 731/1483] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:34:29.357796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d286bce-7da0-4afc-bb69-0251e66314f3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:34:29.370254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d286bce-7da0-4afc-bb69-0251e66314f3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:34:29.374642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e4508-ce76-4a0f-8199-a1d8f2bfa809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:34:29.375266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4508-ce76-4a0f-8199-a1d8f2bfa809 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:29.375538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4508-ce76-4a0f-8199-a1d8f2bfa809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:29.375792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4508-ce76-4a0f-8199-a1d8f2bfa809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:29.386804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4508-ce76-4a0f-8199-a1d8f2bfa809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:34:29.389156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4508-ce76-4a0f-8199-a1d8f2bfa809 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:34:29.399142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 753/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:34:31.620009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fc9ec-eed0-4463-9ede-7f88aaeadb79 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:31.620605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fc9ec-eed0-4463-9ede-7f88aaeadb79 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:31.620605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fc9ec-eed0-4463-9ede-7f88aaeadb79 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:31.621974 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 732/1485] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:34:31.627389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927b0e6-3a41-4ba0-88cc-5bf4f2ccd29f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:31.627812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927b0e6-3a41-4ba0-88cc-5bf4f2ccd29f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:31.627922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927b0e6-3a41-4ba0-88cc-5bf4f2ccd29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:31.645867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d927b0e6-3a41-4ba0-88cc-5bf4f2ccd29f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:34:31.647044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d927b0e6-3a41-4ba0-88cc-5bf4f2ccd29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:34:31.656174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 754/1486] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:34:31.696834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fc9ec-eed0-4463-9ede-7f88aaeadb79 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:34:31.709374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fc9ec-eed0-4463-9ede-7f88aaeadb79 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:34:31.713602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437978e5-a8cf-4298-a086-7d14269da27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:34:31.714238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437978e5-a8cf-4298-a086-7d14269da27f service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:31.714514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437978e5-a8cf-4298-a086-7d14269da27f service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:31.714785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437978e5-a8cf-4298-a086-7d14269da27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:31.723771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437978e5-a8cf-4298-a086-7d14269da27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:34:31.725245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437978e5-a8cf-4298-a086-7d14269da27f service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:34:31.734659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 733/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:34:34.076289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46f84-099e-4250-8931-96aaee7c823b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:34.077130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46f84-099e-4250-8931-96aaee7c823b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:34.077249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46f84-099e-4250-8931-96aaee7c823b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:34.078592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 755/1488] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:34:34.086851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff478a4d-54e0-44eb-81f4-8bb5689b09bc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:34.087488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff478a4d-54e0-44eb-81f4-8bb5689b09bc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:34.087653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff478a4d-54e0-44eb-81f4-8bb5689b09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:34.113847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ff478a4d-54e0-44eb-81f4-8bb5689b09bc None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:34:34.115036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ff478a4d-54e0-44eb-81f4-8bb5689b09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:34:34.125004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 734/1489] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:34:34.165877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46f84-099e-4250-8931-96aaee7c823b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:34:34.179553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46f84-099e-4250-8931-96aaee7c823b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:34:34.184313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809c586-814a-4af4-8ca7-b1b1247a27ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:34:34.184969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809c586-814a-4af4-8ca7-b1b1247a27ef service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:34.185245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809c586-814a-4af4-8ca7-b1b1247a27ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:34.185512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809c586-814a-4af4-8ca7-b1b1247a27ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:34.194957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809c586-814a-4af4-8ca7-b1b1247a27ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:34:34.196383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809c586-814a-4af4-8ca7-b1b1247a27ef service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:34:34.205887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 756/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:34:36.577960 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64608c73-72ff-4c9b-95a1-595dcbe3fbfc None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:36.578596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64608c73-72ff-4c9b-95a1-595dcbe3fbfc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:36.578596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64608c73-72ff-4c9b-95a1-595dcbe3fbfc None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:36.579873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 735/1491] 10.222.0.58 () {54 vars in 926 bytes} [Mon May 16 17:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:34:36.586410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd7303-8747-46d6-acf2-edbf60f8c17d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:36.586886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd7303-8747-46d6-acf2-edbf60f8c17d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:36.586997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd7303-8747-46d6-acf2-edbf60f8c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:36.607701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-46dd7303-8747-46d6-acf2-edbf60f8c17d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:34:36.608897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46dd7303-8747-46d6-acf2-edbf60f8c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:34:36.617495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 757/1492] 10.222.0.58 () {58 vars in 1023 bytes} [Mon May 16 17:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:34:36.656653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64608c73-72ff-4c9b-95a1-595dcbe3fbfc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:34:36.673273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64608c73-72ff-4c9b-95a1-595dcbe3fbfc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:34:36.679251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf483f-9263-449a-84a5-91dd942cbd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:34:36.680167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf483f-9263-449a-84a5-91dd942cbd70 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:34:36.680506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf483f-9263-449a-84a5-91dd942cbd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:34:36.680873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf483f-9263-449a-84a5-91dd942cbd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:34:36.692007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf483f-9263-449a-84a5-91dd942cbd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:34:36.693426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf483f-9263-449a-84a5-91dd942cbd70 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:34:36.702743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 736/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:36:10.218097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979fb5-5262-4db5-b656-93d71497476a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.218607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979fb5-5262-4db5-b656-93d71497476a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.218712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979fb5-5262-4db5-b656-93d71497476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.238244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4d979fb5-5262-4db5-b656-93d71497476a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:10.239389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4d979fb5-5262-4db5-b656-93d71497476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:10.247576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 758/1494] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:10.256784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa833f-bab9-4958-af5c-b97abb87dfbc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.257296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa833f-bab9-4958-af5c-b97abb87dfbc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.257296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa833f-bab9-4958-af5c-b97abb87dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.276341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3eaa833f-bab9-4958-af5c-b97abb87dfbc None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:10.277527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3eaa833f-bab9-4958-af5c-b97abb87dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:10.286503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 737/1495] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:10.290975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979fb5-5262-4db5-b656-93d71497476a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:10.300926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979fb5-5262-4db5-b656-93d71497476a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:10.305920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:10.306564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.307176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.307176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.307807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:36:10.308106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:10.309107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:36:10.309107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 16 17:36:10.309107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: May 16 17:36:10.310027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:10.321408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 759/1496] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:36:10.329743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa833f-bab9-4958-af5c-b97abb87dfbc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:10.338998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa833f-bab9-4958-af5c-b97abb87dfbc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:10.344523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:10.345173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.345437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.345736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.346437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:10.348234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:36:10.348234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 16 17:36:10.348234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: May 16 17:36:10.349483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:10.390966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 738/1497] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:36:10 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:10.395483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:10.405381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ef9c2-9214-405e-b80b-bf3ca0dc5a2c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:10.468744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:10.469626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.469932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.470303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.471249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:10.472802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:36:10.472802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 16 17:36:10.472802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: May 16 17:36:10.474532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:10.502079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 760/1498] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:36:10 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:10.506455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:10.517254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b99a-d0bb-4f94-93d5-c3c2bd9b8226 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:10.523032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:10.523696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.523975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.524242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.524968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:10.526020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:36:10.526020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 16 17:36:10.526020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: May 16 17:36:10.526911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:10.539763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 739/1499] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:10.544824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:10.559832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb496a-7fc9-48f6-a31d-7e21bea341d1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:10.565716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17e1d-c471-4f33-9723-f20c1ddf51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:10.566356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17e1d-c471-4f33-9723-f20c1ddf51ff admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.566627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17e1d-c471-4f33-9723-f20c1ddf51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.566890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17e1d-c471-4f33-9723-f20c1ddf51ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.567603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed17e1d-c471-4f33-9723-f20c1ddf51ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:10.568618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-1ed17e1d-c471-4f33-9723-f20c1ddf51ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:36:10.568618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 16 17:36:10.568618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: May 16 17:36:10.569487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed17e1d-c471-4f33-9723-f20c1ddf51ff admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:10.583692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 761/1500] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:10.587864 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:10.597854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fd0f1-8cd9-4b97-8844-6daaa30a9ae6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:10.602994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7f492-b510-4131-b037-a83c1dcd359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:10.604016 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f492-b510-4131-b037-a83c1dcd359d admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.604320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f492-b510-4131-b037-a83c1dcd359d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.604638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f492-b510-4131-b037-a83c1dcd359d admin admin] PATH_INFO: `/v3/projects/d43748d0f2a041f68d0e3b2fd2a64f8b/users/917a48db83e1490d86c247cc90fbee06/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.619825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7f492-b510-4131-b037-a83c1dcd359d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43748d0f2a041f68d0e3b2fd2a64f8b, user_id=917a48db83e1490d86c247cc90fbee06, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:10.620863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-3af7f492-b510-4131-b037-a83c1dcd359d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:36:10.620863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 16 17:36:10.620863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: May 16 17:36:10.622872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7f492-b510-4131-b037-a83c1dcd359d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:10.636151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 740/1501] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:36:10 2022] PUT /identity/v3/projects/d43748d0f2a041f68d0e3b2fd2a64f8b/users/917a48db83e1490d86c247cc90fbee06/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:10.648178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dfd6c-308b-4411-b3c9-9e1cf7c49fe0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.648522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dfd6c-308b-4411-b3c9-9e1cf7c49fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.648749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dfd6c-308b-4411-b3c9-9e1cf7c49fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.676106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-be9dfd6c-308b-4411-b3c9-9e1cf7c49fe0 None None] MFA Rules not processed for user `917a48db83e1490d86c247cc90fbee06`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:10.677280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-be9dfd6c-308b-4411-b3c9-9e1cf7c49fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:10.739806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 762/1502] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:36:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:10.755598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223312f8-d278-4766-bb49-6286fde5c5c7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.755951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223312f8-d278-4766-bb49-6286fde5c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.756299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223312f8-d278-4766-bb49-6286fde5c5c7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.758533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 741/1503] 10.222.0.58 () {54 vars in 963 bytes} [Mon May 16 17:36:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:36:10.763566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299136-f444-48c1-8690-8cf3fdcd9fbb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.763857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299136-f444-48c1-8690-8cf3fdcd9fbb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.764132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299136-f444-48c1-8690-8cf3fdcd9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.784896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2e299136-f444-48c1-8690-8cf3fdcd9fbb None None] MFA Rules not processed for user `0a0ca8aafef94f3399c92a91f5bff1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:10.786112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2e299136-f444-48c1-8690-8cf3fdcd9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:10.839395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 763/1504] 10.222.0.58 () {58 vars in 1060 bytes} [Mon May 16 17:36:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:10.847129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223312f8-d278-4766-bb49-6286fde5c5c7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:10.860308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223312f8-d278-4766-bb49-6286fde5c5c7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:10.866565 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a710-4d6c-46db-b85b-d1ce5ebea400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:10.867434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a710-4d6c-46db-b85b-d1ce5ebea400 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.867784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a710-4d6c-46db-b85b-d1ce5ebea400 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.868117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a710-4d6c-46db-b85b-d1ce5ebea400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.878226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7a710-4d6c-46db-b85b-d1ce5ebea400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:10.879658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7a710-4d6c-46db-b85b-d1ce5ebea400 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:10.888513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 742/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:36:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:10.931689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8d39-b945-4a89-8b35-f469a2b802cf None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:10.931979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8d39-b945-4a89-8b35-f469a2b802cf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:10.932252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8d39-b945-4a89-8b35-f469a2b802cf None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:10.933575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 764/1506] 10.222.0.58 () {52 vars in 829 bytes} [Mon May 16 17:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:36:10.937448 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a710-4d6c-46db-b85b-d1ce5ebea400 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:11.007701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a710-4d6c-46db-b85b-d1ce5ebea400 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:11.015155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:11.016053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:11.016330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:11.016600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] PATH_INFO: `/v3/users/917a48db83e1490d86c247cc90fbee06` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:11.017941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917a48db83e1490d86c247cc90fbee06)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:11.018979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:36:11.018979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 16 17:36:11.018979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: May 16 17:36:11.020203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:11.091703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917a48db83e1490d86c247cc90fbee06'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.110177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917a48db83e1490d86c247cc90fbee06'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.111055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917a48db83e1490d86c247cc90fbee06'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.111817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917a48db83e1490d86c247cc90fbee06'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.124088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917a48db83e1490d86c247cc90fbee06'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.141854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 743/1507] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:36:10 2022] DELETE /identity/v3/users/917a48db83e1490d86c247cc90fbee06 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:36:11.146487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2172f-6a58-4db0-9390-ff75ceaeb6c6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:11.146766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2172f-6a58-4db0-9390-ff75ceaeb6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:11.147156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2172f-6a58-4db0-9390-ff75ceaeb6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:11.165226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-59c2172f-6a58-4db0-9390-ff75ceaeb6c6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:11.166471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-59c2172f-6a58-4db0-9390-ff75ceaeb6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:11.225864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 765/1508] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:36:11.237209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:11.238931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:11.297465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49796bd-7192-4fed-aa72-19c5a6c99ba1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:11.302287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e341856-86a2-4e12-a3db-d82e4a6037f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:11.302947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e341856-86a2-4e12-a3db-d82e4a6037f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:11.303216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e341856-86a2-4e12-a3db-d82e4a6037f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:11.303486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e341856-86a2-4e12-a3db-d82e4a6037f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:11.315490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e341856-86a2-4e12-a3db-d82e4a6037f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:11.317039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e341856-86a2-4e12-a3db-d82e4a6037f2 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:11.327300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 744/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:11.666243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2172f-6a58-4db0-9390-ff75ceaeb6c6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:11.667670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-59c2172f-6a58-4db0-9390-ff75ceaeb6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:11.680058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2172f-6a58-4db0-9390-ff75ceaeb6c6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:11.684920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:11.686547 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:11.686831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:11.687101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] PATH_INFO: `/v3/projects/d43748d0f2a041f68d0e3b2fd2a64f8b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:11.688389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43748d0f2a041f68d0e3b2fd2a64f8b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:11.689459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:36:11.689459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 16 17:36:11.689459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: May 16 17:36:11.690739 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:11.755603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43748d0f2a041f68d0e3b2fd2a64f8b', 'request_id': 'req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.768852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43748d0f2a041f68d0e3b2fd2a64f8b', 'request_id': 'req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.780215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43748d0f2a041f68d0e3b2fd2a64f8b', 'request_id': 'req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.791095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] The token cache is being invalidate because project d43748d0f2a041f68d0e3b2fd2a64f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:11.791358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.791972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e2b77e0d-48e4-40ec-a40d-2090a3c96e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:11.793735 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 766/1510] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:36:11 2022] DELETE /identity/v3/projects/d43748d0f2a041f68d0e3b2fd2a64f8b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:37:54.337935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6aa6f-a63c-4a71-8a56-420326e679c3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:54.338562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6aa6f-a63c-4a71-8a56-420326e679c3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:54.338562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6aa6f-a63c-4a71-8a56-420326e679c3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:54.339911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:37:54.345995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615327-474b-4c56-bed9-3ab6fcddbb3f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:54.346742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615327-474b-4c56-bed9-3ab6fcddbb3f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:54.346887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615327-474b-4c56-bed9-3ab6fcddbb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:54.373942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-75615327-474b-4c56-bed9-3ab6fcddbb3f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:37:54.375166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-75615327-474b-4c56-bed9-3ab6fcddbb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:37:54.444388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:37:54.611233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6aa6f-a63c-4a71-8a56-420326e679c3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:37:54.614102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-81e6aa6f-a63c-4a71-8a56-420326e679c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:37:54.704627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6aa6f-a63c-4a71-8a56-420326e679c3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:37:54.710899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad601-f52b-4b8c-b2eb-9423c924e16d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:37:54.711560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad601-f52b-4b8c-b2eb-9423c924e16d service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:54.711832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad601-f52b-4b8c-b2eb-9423c924e16d service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:54.712101 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad601-f52b-4b8c-b2eb-9423c924e16d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:54.721119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ad601-f52b-4b8c-b2eb-9423c924e16d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:37:54.722726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ad601-f52b-4b8c-b2eb-9423c924e16d service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:37:54.733392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 746/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:37:55.369377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa3916-aec8-44b9-88a8-16dcece94c2f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:55.370036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa3916-aec8-44b9-88a8-16dcece94c2f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:55.370036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa3916-aec8-44b9-88a8-16dcece94c2f None None] PATH_INFO: `/v3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:55.371336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 768/1514] 10.222.0.35 () {54 vars in 925 bytes} [Mon May 16 17:37:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:37:55.377785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c33ca-5c6b-45a2-83f0-f8a5ea8f3f03 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:55.378234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c33ca-5c6b-45a2-83f0-f8a5ea8f3f03 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:55.378377 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c33ca-5c6b-45a2-83f0-f8a5ea8f3f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:55.398250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cf3c33ca-5c6b-45a2-83f0-f8a5ea8f3f03 None None] MFA Rules not processed for user `02938c77178a4f14a33ff1298775687c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:37:55.399527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cf3c33ca-5c6b-45a2-83f0-f8a5ea8f3f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:37:55.461656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 747/1515] 10.222.0.35 () {58 vars in 1015 bytes} [Mon May 16 17:37:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:37:55.644797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2f11-64bd-4ead-b614-c84241383d9b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:55.645148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2f11-64bd-4ead-b614-c84241383d9b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:55.645501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2f11-64bd-4ead-b614-c84241383d9b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:55.647772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 769/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:37:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:37:55.653542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23a7b-23a1-4b89-af58-8473c5aea4c5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:55.653907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23a7b-23a1-4b89-af58-8473c5aea4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:55.654327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23a7b-23a1-4b89-af58-8473c5aea4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:55.682559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-94c23a7b-23a1-4b89-af58-8473c5aea4c5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:37:55.683754 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-94c23a7b-23a1-4b89-af58-8473c5aea4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:37:55.694850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 748/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:37:55.851839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d2f11-64bd-4ead-b614-c84241383d9b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:37:55.867644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d2f11-64bd-4ead-b614-c84241383d9b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:37:55.873490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d69389-effb-49e0-b38e-37ef9e41b3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:37:55.874160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69389-effb-49e0-b38e-37ef9e41b3ac service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:55.874440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69389-effb-49e0-b38e-37ef9e41b3ac service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:55.874708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69389-effb-49e0-b38e-37ef9e41b3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:55.882746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d69389-effb-49e0-b38e-37ef9e41b3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:37:55.884364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d69389-effb-49e0-b38e-37ef9e41b3ac service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:37:55.893897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 770/1518] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:37:59.358490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c08d7-5938-4d5b-bf01-27140f83aa1b None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:59.359127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c08d7-5938-4d5b-bf01-27140f83aa1b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:59.359127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c08d7-5938-4d5b-bf01-27140f83aa1b None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:59.360515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 749/1519] 10.222.0.58 () {54 vars in 960 bytes} [Mon May 16 17:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:37:59.365817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0160-ac2a-4917-b844-61b7eeab83da None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:59.366247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0160-ac2a-4917-b844-61b7eeab83da None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:59.366412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0160-ac2a-4917-b844-61b7eeab83da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:59.386952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-54ca0160-ac2a-4917-b844-61b7eeab83da None None] MFA Rules not processed for user `02938c77178a4f14a33ff1298775687c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:37:59.388255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54ca0160-ac2a-4917-b844-61b7eeab83da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:37:59.397900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 771/1520] 10.222.0.58 () {58 vars in 1057 bytes} [Mon May 16 17:37:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:37:59.405708 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c08d7-5938-4d5b-bf01-27140f83aa1b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:37:59.420384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c08d7-5938-4d5b-bf01-27140f83aa1b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:37:59.426814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b36f6-07cc-4684-b6f1-0c4e23f37398 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02938c77178a4f14a33ff1298775687c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:37:59.427511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b36f6-07cc-4684-b6f1-0c4e23f37398 service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:59.427822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b36f6-07cc-4684-b6f1-0c4e23f37398 service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:59.428149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b36f6-07cc-4684-b6f1-0c4e23f37398 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:59.437086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b36f6-07cc-4684-b6f1-0c4e23f37398 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:37:59.438805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b36f6-07cc-4684-b6f1-0c4e23f37398 service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:37:59.451586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 750/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:37:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:38:07.212945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f689de-b7b8-44b8-8dec-87161d42e534 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:07.213405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f689de-b7b8-44b8-8dec-87161d42e534 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:07.213506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f689de-b7b8-44b8-8dec-87161d42e534 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:07.215668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:38:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:38:07.220597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1d2d-cbf3-4504-8cc7-51b2ac6185c9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:07.221035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1d2d-cbf3-4504-8cc7-51b2ac6185c9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:07.221150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1d2d-cbf3-4504-8cc7-51b2ac6185c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:07.240021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-315d1d2d-cbf3-4504-8cc7-51b2ac6185c9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:38:07.241191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-315d1d2d-cbf3-4504-8cc7-51b2ac6185c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:07.250329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:38:07.399917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f689de-b7b8-44b8-8dec-87161d42e534 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:38:07.423722 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f689de-b7b8-44b8-8dec-87161d42e534 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:38:07.432366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48d9dd-cbee-4c40-8c6b-0a3b4cace383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:38:07.433075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d9dd-cbee-4c40-8c6b-0a3b4cace383 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:07.433350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d9dd-cbee-4c40-8c6b-0a3b4cace383 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:07.433644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d9dd-cbee-4c40-8c6b-0a3b4cace383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:07.446686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48d9dd-cbee-4c40-8c6b-0a3b4cace383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:38:07.448395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48d9dd-cbee-4c40-8c6b-0a3b4cace383 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:38:07.458662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 773/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:38:08.330750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599d70-c5ca-4cb3-8a12-3646d85ed84c None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:08.331605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599d70-c5ca-4cb3-8a12-3646d85ed84c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:08.331605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599d70-c5ca-4cb3-8a12-3646d85ed84c None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:08.333950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 17:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:38:08.340437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206bf78-7312-4d5a-9cdd-0fdfdf5a06a0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:08.340845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206bf78-7312-4d5a-9cdd-0fdfdf5a06a0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:08.340990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206bf78-7312-4d5a-9cdd-0fdfdf5a06a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:08.360379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e206bf78-7312-4d5a-9cdd-0fdfdf5a06a0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:38:08.361596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e206bf78-7312-4d5a-9cdd-0fdfdf5a06a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:08.371579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 17:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:38:08.523800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599d70-c5ca-4cb3-8a12-3646d85ed84c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:38:08.540775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599d70-c5ca-4cb3-8a12-3646d85ed84c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:38:08.546741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43f6c8-c21d-4be4-ad87-33088b5be098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:38:08.547684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f6c8-c21d-4be4-ad87-33088b5be098 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:08.547957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f6c8-c21d-4be4-ad87-33088b5be098 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:08.548223 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f6c8-c21d-4be4-ad87-33088b5be098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:08.556400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f6c8-c21d-4be4-ad87-33088b5be098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:38:08.558012 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f6c8-c21d-4be4-ad87-33088b5be098 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:38:08.570619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 753/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:38:12.641602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b427ae-d245-4d5e-95a1-d19a802e8f8d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:12.642608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b427ae-d245-4d5e-95a1-d19a802e8f8d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:12.642608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b427ae-d245-4d5e-95a1-d19a802e8f8d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:12.644914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:38:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:38:12.650362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4e10-33e3-4285-b3d1-e3cf4d2f176d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:12.650816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4e10-33e3-4285-b3d1-e3cf4d2f176d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:12.651012 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4e10-33e3-4285-b3d1-e3cf4d2f176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:12.670392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b43d4e10-33e3-4285-b3d1-e3cf4d2f176d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:38:12.671579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b43d4e10-33e3-4285-b3d1-e3cf4d2f176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:12.680143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:38:12.717218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b427ae-d245-4d5e-95a1-d19a802e8f8d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:38:12.720252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b2b427ae-d245-4d5e-95a1-d19a802e8f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:12.780281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b427ae-d245-4d5e-95a1-d19a802e8f8d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:38:12.784216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b8380-2089-4a89-ba7d-9042f616908e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:38:12.784843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8380-2089-4a89-ba7d-9042f616908e service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:12.785126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8380-2089-4a89-ba7d-9042f616908e service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:12.785394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8380-2089-4a89-ba7d-9042f616908e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:12.794766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b8380-2089-4a89-ba7d-9042f616908e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:38:12.796196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b8380-2089-4a89-ba7d-9042f616908e service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:38:12.805890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 776/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:38:14.978627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a415e2-52ef-465f-9541-8000823ab5d7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:14.979225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a415e2-52ef-465f-9541-8000823ab5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:14.979225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a415e2-52ef-465f-9541-8000823ab5d7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:14.980545 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:38:14.986012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e60e0b-2736-4376-b1ed-cd1feac2d76c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:14.986477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e60e0b-2736-4376-b1ed-cd1feac2d76c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:14.986477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e60e0b-2736-4376-b1ed-cd1feac2d76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:15.012572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-94e60e0b-2736-4376-b1ed-cd1feac2d76c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:38:15.013807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-94e60e0b-2736-4376-b1ed-cd1feac2d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:15.023180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:38:15.058523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a415e2-52ef-465f-9541-8000823ab5d7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:38:15.074078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a415e2-52ef-465f-9541-8000823ab5d7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:38:15.080359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b79dc6-7c18-4199-95e3-eb4aa2447f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:38:15.081296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b79dc6-7c18-4199-95e3-eb4aa2447f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:15.081695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b79dc6-7c18-4199-95e3-eb4aa2447f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:15.082056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b79dc6-7c18-4199-95e3-eb4aa2447f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:15.093844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b79dc6-7c18-4199-95e3-eb4aa2447f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:38:15.095241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b79dc6-7c18-4199-95e3-eb4aa2447f69 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:38:15.106850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 756/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:38:19.022620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67eee7-141c-4dd9-8212-f24c242b8628 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:19.023403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67eee7-141c-4dd9-8212-f24c242b8628 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:19.023403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67eee7-141c-4dd9-8212-f24c242b8628 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:19.025276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:38:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:38:19.031929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cdc00-48f0-4cf3-9371-4f689da9e14a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:19.032470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cdc00-48f0-4cf3-9371-4f689da9e14a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:19.032582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cdc00-48f0-4cf3-9371-4f689da9e14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:19.061249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-df9cdc00-48f0-4cf3-9371-4f689da9e14a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:38:19.062492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-df9cdc00-48f0-4cf3-9371-4f689da9e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:19.071428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:38:19.350970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67eee7-141c-4dd9-8212-f24c242b8628 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:38:19.353542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ae67eee7-141c-4dd9-8212-f24c242b8628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:19.415147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67eee7-141c-4dd9-8212-f24c242b8628 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:38:19.419516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd67cd2-1c22-49fd-9bb7-9cc591fac0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:38:19.420162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd67cd2-1c22-49fd-9bb7-9cc591fac0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:19.420442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd67cd2-1c22-49fd-9bb7-9cc591fac0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:19.420716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd67cd2-1c22-49fd-9bb7-9cc591fac0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:19.430549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd67cd2-1c22-49fd-9bb7-9cc591fac0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:38:19.432006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd67cd2-1c22-49fd-9bb7-9cc591fac0e1 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:38:19.441976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 779/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:38:21.744971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432a507-ece2-4a87-a504-05ea9a67ba62 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:21.745776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432a507-ece2-4a87-a504-05ea9a67ba62 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:21.745776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432a507-ece2-4a87-a504-05ea9a67ba62 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:21.747829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 17:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:38:21.755803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ecc9-0c08-42c2-8454-2f0e8a5e6032 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:21.756264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ecc9-0c08-42c2-8454-2f0e8a5e6032 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:21.756391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ecc9-0c08-42c2-8454-2f0e8a5e6032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:21.775525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3934ecc9-0c08-42c2-8454-2f0e8a5e6032 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:38:21.776690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3934ecc9-0c08-42c2-8454-2f0e8a5e6032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:21.785008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 17:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:38:22.061141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432a507-ece2-4a87-a504-05ea9a67ba62 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:38:22.064253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e432a507-ece2-4a87-a504-05ea9a67ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:38:22.086399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432a507-ece2-4a87-a504-05ea9a67ba62 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:38:22.090846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12030a7-994b-43cd-8e17-379d6837b482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:38:22.091491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12030a7-994b-43cd-8e17-379d6837b482 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:38:22.091774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12030a7-994b-43cd-8e17-379d6837b482 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:38:22.092077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12030a7-994b-43cd-8e17-379d6837b482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:38:22.100953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12030a7-994b-43cd-8e17-379d6837b482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:38:22.102442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12030a7-994b-43cd-8e17-379d6837b482 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:38:22.112000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 759/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:52.092826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca57c2-1fe9-4ef2-8dae-6e195e3e8a2d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.093971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca57c2-1fe9-4ef2-8dae-6e195e3e8a2d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.094418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca57c2-1fe9-4ef2-8dae-6e195e3e8a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.124395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b3ca57c2-1fe9-4ef2-8dae-6e195e3e8a2d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.125919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b3ca57c2-1fe9-4ef2-8dae-6e195e3e8a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.137670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 781/1540] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.149364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4f06-189a-49ff-befa-4265e6752624 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.150007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4f06-189a-49ff-befa-4265e6752624 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.150171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4f06-189a-49ff-befa-4265e6752624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.177852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222742e1-9226-46b9-9d0f-06a5a0158ffe None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.178506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222742e1-9226-46b9-9d0f-06a5a0158ffe None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.179123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222742e1-9226-46b9-9d0f-06a5a0158ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.179875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8fdb4f06-189a-49ff-befa-4265e6752624 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.181197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8fdb4f06-189a-49ff-befa-4265e6752624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.195826 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 760/1541] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:39:52.200471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb4f06-189a-49ff-befa-4265e6752624 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.204859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-222742e1-9226-46b9-9d0f-06a5a0158ffe None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.206767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-222742e1-9226-46b9-9d0f-06a5a0158ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.210801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb4f06-189a-49ff-befa-4265e6752624 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.216486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 782/1542] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.226323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12458-3c22-4248-9c2a-f4cc450e71f2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.227146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12458-3c22-4248-9c2a-f4cc450e71f2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.227696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12458-3c22-4248-9c2a-f4cc450e71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.230359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.231054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.231330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.231726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.232467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:52.232773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.233822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:39:52.233822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 16 17:39:52.233822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: May 16 17:39:52.234719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.253007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 761/1543] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:39:52.258116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-07e12458-3c22-4248-9c2a-f4cc450e71f2 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.259541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-07e12458-3c22-4248-9c2a-f4cc450e71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.261307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.272371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 783/1544] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:39:52.278167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0459ee-5321-4386-830e-59d8dfbcbecf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.279042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e12458-3c22-4248-9c2a-f4cc450e71f2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.287767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bb38-b2c9-4203-bbe0-1f8990d152f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.288554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bb38-b2c9-4203-bbe0-1f8990d152f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.288843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bb38-b2c9-4203-bbe0-1f8990d152f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.289116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bb38-b2c9-4203-bbe0-1f8990d152f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.289838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7bb38-b2c9-4203-bbe0-1f8990d152f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.295822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7bb38-b2c9-4203-bbe0-1f8990d152f4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.300604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e12458-3c22-4248-9c2a-f4cc450e71f2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.310442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.311546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.312059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.312541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.313523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:52.314090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.315982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.344465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 784/1545] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:39:52.350291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 762/1546] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:39:52.352459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.354948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bb38-b2c9-4203-bbe0-1f8990d152f4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.371234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fa7e-9405-4d91-b5f4-1da322f9044e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.428816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bb38-b2c9-4203-bbe0-1f8990d152f4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.434285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.435021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.435303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.435588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.436568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.437660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:39:52.437660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 16 17:39:52.437660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: May 16 17:39:52.439403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.465867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 763/1547] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:52.470119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.480937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bec347-4322-40b1-9e5a-21ff25a2b1b3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.486521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e47c-b048-4e44-8cc6-38fa16c1efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.487212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e47c-b048-4e44-8cc6-38fa16c1efe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.487495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e47c-b048-4e44-8cc6-38fa16c1efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.487774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e47c-b048-4e44-8cc6-38fa16c1efe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.488516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796e47c-b048-4e44-8cc6-38fa16c1efe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.490560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796e47c-b048-4e44-8cc6-38fa16c1efe4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.497133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.498231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.498763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.499247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.500159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.501907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:39:52.501907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 16 17:39:52.501907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: May 16 17:39:52.502699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 764/1548] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:52.503749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.507069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e47c-b048-4e44-8cc6-38fa16c1efe4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.523731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e47c-b048-4e44-8cc6-38fa16c1efe4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.532424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc210bb-7614-4009-9649-ea34456703d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.533116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc210bb-7614-4009-9649-ea34456703d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.533398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc210bb-7614-4009-9649-ea34456703d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.533700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc210bb-7614-4009-9649-ea34456703d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.534436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc210bb-7614-4009-9649-ea34456703d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.536139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc210bb-7614-4009-9649-ea34456703d5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.554566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 765/1549] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:39:52.559784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc210bb-7614-4009-9649-ea34456703d5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.575196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 785/1550] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/projects => generated 363 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:52.579356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.588317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc210bb-7614-4009-9649-ea34456703d5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.692638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126c82e-2ca5-4d26-b302-2e580e08f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.693516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c82e-2ca5-4d26-b302-2e580e08f111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.693832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c82e-2ca5-4d26-b302-2e580e08f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.694117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c82e-2ca5-4d26-b302-2e580e08f111 admin admin] PATH_INFO: `/v3/projects/c4c1d398e6214fec98dbd4baf7e7e560/users/8ae5a7cc098f4a9f98d5e09a2095e95d/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.718011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a71a8-2cf3-4b55-81cd-3bb69ff83275 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.723785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126c82e-2ca5-4d26-b302-2e580e08f111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c1d398e6214fec98dbd4baf7e7e560, user_id=8ae5a7cc098f4a9f98d5e09a2095e95d, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.724975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27f813-4be0-4ca3-848c-a0df0fcf1958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.725952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27f813-4be0-4ca3-848c-a0df0fcf1958 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.726464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27f813-4be0-4ca3-848c-a0df0fcf1958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.726690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126c82e-2ca5-4d26-b302-2e580e08f111 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.727163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27f813-4be0-4ca3-848c-a0df0fcf1958 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.728276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27f813-4be0-4ca3-848c-a0df0fcf1958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.731770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27f813-4be0-4ca3-848c-a0df0fcf1958 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.742285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 766/1551] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:52 2022] PUT /identity/v3/projects/c4c1d398e6214fec98dbd4baf7e7e560/users/8ae5a7cc098f4a9f98d5e09a2095e95d/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:52.744080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd350bf-ffe4-4546-82d0-f129fbd4bec1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.744516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd350bf-ffe4-4546-82d0-f129fbd4bec1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.745006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd350bf-ffe4-4546-82d0-f129fbd4bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.763225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 786/1552] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:52.764722 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f95e1-8271-4620-bef2-55218524edab None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.764862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9bd350bf-ffe4-4546-82d0-f129fbd4bec1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.768055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f95e1-8271-4620-bef2-55218524edab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.768055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f95e1-8271-4620-bef2-55218524edab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.769823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9bd350bf-ffe4-4546-82d0-f129fbd4bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.790596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ee6f95e1-8271-4620-bef2-55218524edab None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.791806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ee6f95e1-8271-4620-bef2-55218524edab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.826867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 767/1553] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.828249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91575273-4712-49d4-be44-e89c174c921a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.828548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91575273-4712-49d4-be44-e89c174c921a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.828809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91575273-4712-49d4-be44-e89c174c921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.847989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-91575273-4712-49d4-be44-e89c174c921a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.849191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-91575273-4712-49d4-be44-e89c174c921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.856644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 787/1554] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.858161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e1824-47e7-4444-b0cf-e943bb828c88 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.858495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e1824-47e7-4444-b0cf-e943bb828c88 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.858828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e1824-47e7-4444-b0cf-e943bb828c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.861693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 768/1555] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.863496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22a42-17df-4985-8090-1db4a969e4b8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.864083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22a42-17df-4985-8090-1db4a969e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.864525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22a42-17df-4985-8090-1db4a969e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.877143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-eb4e1824-47e7-4444-b0cf-e943bb828c88 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.878355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eb4e1824-47e7-4444-b0cf-e943bb828c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.886186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 788/1556] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.887105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e1824-47e7-4444-b0cf-e943bb828c88 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:52.890358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fbe22a42-17df-4985-8090-1db4a969e4b8 None None] MFA Rules not processed for user `8ae5a7cc098f4a9f98d5e09a2095e95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.891530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fbe22a42-17df-4985-8090-1db4a969e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.896018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e1824-47e7-4444-b0cf-e943bb828c88 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:52.900520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6a0cb-aae7-4df3-99ea-0f54f6d048d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:52.901172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6a0cb-aae7-4df3-99ea-0f54f6d048d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.901444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6a0cb-aae7-4df3-99ea-0f54f6d048d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.901740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6a0cb-aae7-4df3-99ea-0f54f6d048d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.902465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6a0cb-aae7-4df3-99ea-0f54f6d048d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:52.904064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6a0cb-aae7-4df3-99ea-0f54f6d048d0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:52.913824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 789/1557] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:52.915054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a7fe-9ea2-4f76-8863-5dd5c2209fbd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.915337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a7fe-9ea2-4f76-8863-5dd5c2209fbd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.915605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a7fe-9ea2-4f76-8863-5dd5c2209fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.934369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-df16a7fe-9ea2-4f76-8863-5dd5c2209fbd None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.935526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-df16a7fe-9ea2-4f76-8863-5dd5c2209fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.943615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 790/1558] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.944734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c603b-d7f2-4fac-a856-35742eeb2d72 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.944995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c603b-d7f2-4fac-a856-35742eeb2d72 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.945259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c603b-d7f2-4fac-a856-35742eeb2d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.954500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 769/1559] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.955881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eddc02-b54b-4183-bded-f1afacab7161 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.956250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eddc02-b54b-4183-bded-f1afacab7161 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.956493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eddc02-b54b-4183-bded-f1afacab7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.965433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f78c603b-d7f2-4fac-a856-35742eeb2d72 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.966791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f78c603b-d7f2-4fac-a856-35742eeb2d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.974308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-02eddc02-b54b-4183-bded-f1afacab7161 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.975511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 791/1560] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.975632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-02eddc02-b54b-4183-bded-f1afacab7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:52.976742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7bf2-eb92-405d-b652-5141b581c1bd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.977025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7bf2-eb92-405d-b652-5141b581c1bd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.977289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7bf2-eb92-405d-b652-5141b581c1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.987400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 770/1561] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:52.988703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97b69-6c21-41df-9ab2-81e876f489ab None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:52.988981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97b69-6c21-41df-9ab2-81e876f489ab None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:52.989241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97b69-6c21-41df-9ab2-81e876f489ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:52.995014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5b9c7bf2-eb92-405d-b652-5141b581c1bd None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:52.996254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5b9c7bf2-eb92-405d-b652-5141b581c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:53.004249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 792/1562] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:53.005446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c145-1659-4869-a5c7-48913aaddd80 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.005765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c145-1659-4869-a5c7-48913aaddd80 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.006093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c145-1659-4869-a5c7-48913aaddd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.007331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e7d97b69-6c21-41df-9ab2-81e876f489ab None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:53.008889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e7d97b69-6c21-41df-9ab2-81e876f489ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:53.016547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 771/1563] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:53.017411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d97b69-6c21-41df-9ab2-81e876f489ab None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.023343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3e52c145-1659-4869-a5c7-48913aaddd80 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:53.024490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3e52c145-1659-4869-a5c7-48913aaddd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:53.026320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d97b69-6c21-41df-9ab2-81e876f489ab None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.030844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cd5fb-de0e-4b11-9233-8147ecbd2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.031609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd5fb-de0e-4b11-9233-8147ecbd2576 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.031984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd5fb-de0e-4b11-9233-8147ecbd2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.032225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 793/1564] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:53.032379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd5fb-de0e-4b11-9233-8147ecbd2576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.033153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cd5fb-de0e-4b11-9233-8147ecbd2576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.033402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6348fd0-aa66-4759-8877-bcdb2a7efbe8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.033729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6348fd0-aa66-4759-8877-bcdb2a7efbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.034002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6348fd0-aa66-4759-8877-bcdb2a7efbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.034988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cd5fb-de0e-4b11-9233-8147ecbd2576 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.047110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 772/1565] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:53.047110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715f223-5e15-472c-a356-2ab78b9b2cf3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.047496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715f223-5e15-472c-a356-2ab78b9b2cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.047496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715f223-5e15-472c-a356-2ab78b9b2cf3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.048899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 773/1566] 10.222.0.58 () {54 vars in 961 bytes} [Mon May 16 17:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:39:53.049998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b929-16ef-4e62-a2a8-339758a0714c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.050285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b929-16ef-4e62-a2a8-339758a0714c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.050523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b929-16ef-4e62-a2a8-339758a0714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.054907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b6348fd0-aa66-4759-8877-bcdb2a7efbe8 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:53.056152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b6348fd0-aa66-4759-8877-bcdb2a7efbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:53.064063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 794/1567] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:53.064879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6348fd0-aa66-4759-8877-bcdb2a7efbe8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.068296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5615b929-16ef-4e62-a2a8-339758a0714c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:53.069521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5615b929-16ef-4e62-a2a8-339758a0714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:53.074621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6348fd0-aa66-4759-8877-bcdb2a7efbe8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.077281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 774/1568] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:53.078076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615b929-16ef-4e62-a2a8-339758a0714c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.080038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.080822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.081106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.081497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.082267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:53.082606 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.084407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.087623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615b929-16ef-4e62-a2a8-339758a0714c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.092961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.093835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.094113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.094377 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.095107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:53.095407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.097039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.102997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 795/1569] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:39:53.104137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.109198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 775/1570] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:39:53.110368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.113465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e825-b1d5-43e0-a528-939b8dcd71de admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.118936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.119579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.119853 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.120123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.120841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:53.121142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.122778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.125017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abfa36-38b5-4559-827f-9bdf7b24b696 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.129461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da0648-b213-4422-bf8b-8ce0201ab1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.130135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0648-b213-4422-bf8b-8ce0201ab1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.130417 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0648-b213-4422-bf8b-8ce0201ab1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.130690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0648-b213-4422-bf8b-8ce0201ab1dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.131521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da0648-b213-4422-bf8b-8ce0201ab1dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:53.131826 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da0648-b213-4422-bf8b-8ce0201ab1dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.133416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da0648-b213-4422-bf8b-8ce0201ab1dd admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.134419 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 796/1571] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:39:53.135175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.145081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b072aac-9022-4647-8959-377c78b9b3a4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.148019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 776/1572] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:39:53.150044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.150969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.151161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c378c80-2474-44f5-8f39-733638acad8a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.151633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c378c80-2474-44f5-8f39-733638acad8a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.151745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.151745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] PATH_INFO: `/v3/projects/d46b5de0228b41b8b7f1f7cbb3d10fb9/users/b0ca7baf0d3f450ba7e582c3c303a8f5/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.151926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c378c80-2474-44f5-8f39-733638acad8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.166555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46b5de0228b41b8b7f1f7cbb3d10fb9, user_id=b0ca7baf0d3f450ba7e582c3c303a8f5, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.167592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:39:53.167592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 16 17:39:53.167592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: May 16 17:39:53.169525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.170421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3c378c80-2474-44f5-8f39-733638acad8a None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:53.171930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3c378c80-2474-44f5-8f39-733638acad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:53.183050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 797/1573] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:53 2022] PUT /identity/v3/projects/d46b5de0228b41b8b7f1f7cbb3d10fb9/users/b0ca7baf0d3f450ba7e582c3c303a8f5/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:53.184092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.235939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 777/1574] 10.222.0.58 () {58 vars in 1058 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:53.236843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c378c80-2474-44f5-8f39-733638acad8a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.246573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c378c80-2474-44f5-8f39-733638acad8a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.250855 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.251392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801a8fe-f4e9-48ea-bcf3-9512657e4cd7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.251513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.251742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.252043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.252716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:53.253014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.254651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.256030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.256681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.256962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.257244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.257988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:53.258299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.259925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.265704 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 778/1575] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:39:53.266528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.273792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 798/1576] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:39:53.273792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.276194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b659ece-8e56-420a-8870-875ca85db10b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.280832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac08662-657f-4d73-b24e-a7898ca7665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.281462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac08662-657f-4d73-b24e-a7898ca7665d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.281764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac08662-657f-4d73-b24e-a7898ca7665d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.282034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac08662-657f-4d73-b24e-a7898ca7665d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.282709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac08662-657f-4d73-b24e-a7898ca7665d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.283185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb31dde-263a-46be-8c4f-af9b7b88aa2d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.284651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac08662-657f-4d73-b24e-a7898ca7665d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.288017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cbc5c-d426-468d-9117-62232892f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.288700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbc5c-d426-468d-9117-62232892f8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.289007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbc5c-d426-468d-9117-62232892f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.289286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbc5c-d426-468d-9117-62232892f8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.290034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cbc5c-d426-468d-9117-62232892f8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.291961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cbc5c-d426-468d-9117-62232892f8f1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.311110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 779/1577] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.312133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac08662-657f-4d73-b24e-a7898ca7665d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.321158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 799/1578] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.321158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cbc5c-d426-468d-9117-62232892f8f1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.375116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac08662-657f-4d73-b24e-a7898ca7665d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.378867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cbc5c-d426-468d-9117-62232892f8f1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.379929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bfc34-5ee4-4937-a855-9701e4415e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.380576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bfc34-5ee4-4937-a855-9701e4415e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.380920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bfc34-5ee4-4937-a855-9701e4415e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.381395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bfc34-5ee4-4937-a855-9701e4415e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.383364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bfc34-5ee4-4937-a855-9701e4415e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.384007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc16b0-595f-4dd6-966d-77f394e8fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.384673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc16b0-595f-4dd6-966d-77f394e8fd67 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.384955 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc16b0-595f-4dd6-966d-77f394e8fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.385219 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc16b0-595f-4dd6-966d-77f394e8fd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.385944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc16b0-595f-4dd6-966d-77f394e8fd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.386567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bfc34-5ee4-4937-a855-9701e4415e73 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.387854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc16b0-595f-4dd6-966d-77f394e8fd67 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.413219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 780/1579] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.414634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406e5bf-9fae-4cf4-9e60-00b2f5001437 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.414917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406e5bf-9fae-4cf4-9e60-00b2f5001437 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.415191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406e5bf-9fae-4cf4-9e60-00b2f5001437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.419380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 800/1580] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.419380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc16b0-595f-4dd6-966d-77f394e8fd67 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.444216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2406e5bf-9fae-4cf4-9e60-00b2f5001437 None None] MFA Rules not processed for user `b0ca7baf0d3f450ba7e582c3c303a8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:53.445479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2406e5bf-9fae-4cf4-9e60-00b2f5001437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:53.487222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc16b0-595f-4dd6-966d-77f394e8fd67 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.493325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1513-9942-41fa-8b32-17bb1e7ac410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.494020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1513-9942-41fa-8b32-17bb1e7ac410 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.494300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1513-9942-41fa-8b32-17bb1e7ac410 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.494571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1513-9942-41fa-8b32-17bb1e7ac410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.508324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 781/1581] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:53.509184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406e5bf-9fae-4cf4-9e60-00b2f5001437 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.551632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab1513-9942-41fa-8b32-17bb1e7ac410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.553476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab1513-9942-41fa-8b32-17bb1e7ac410 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.562582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 801/1582] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:53.563329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1513-9942-41fa-8b32-17bb1e7ac410 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.569468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406e5bf-9fae-4cf4-9e60-00b2f5001437 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.573140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1513-9942-41fa-8b32-17bb1e7ac410 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.573959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0387364-9bf3-40c7-9ebe-f5e60a853fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.574613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387364-9bf3-40c7-9ebe-f5e60a853fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.574887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387364-9bf3-40c7-9ebe-f5e60a853fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.575150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387364-9bf3-40c7-9ebe-f5e60a853fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.575828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0387364-9bf3-40c7-9ebe-f5e60a853fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.577681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890c65-3310-4eee-a974-8fef89a8c9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.577828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0387364-9bf3-40c7-9ebe-f5e60a853fc6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.578315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890c65-3310-4eee-a974-8fef89a8c9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.578596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890c65-3310-4eee-a974-8fef89a8c9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.578870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890c65-3310-4eee-a974-8fef89a8c9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.579566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890c65-3310-4eee-a974-8fef89a8c9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.581727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890c65-3310-4eee-a974-8fef89a8c9ad admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.609523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 802/1583] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.609523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890c65-3310-4eee-a974-8fef89a8c9ad admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.609871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 782/1584] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.609871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0387364-9bf3-40c7-9ebe-f5e60a853fc6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.669855 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0387364-9bf3-40c7-9ebe-f5e60a853fc6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.671274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890c65-3310-4eee-a974-8fef89a8c9ad admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.675068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd883-13ab-4f95-a426-d87caf66cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.675741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd4e5-a683-430e-bfe5-79600ccf15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.675909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd883-13ab-4f95-a426-d87caf66cb6f admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.676284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd883-13ab-4f95-a426-d87caf66cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.676435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd4e5-a683-430e-bfe5-79600ccf15c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.676677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd883-13ab-4f95-a426-d87caf66cb6f admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.676774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd4e5-a683-430e-bfe5-79600ccf15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.676981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd4e5-a683-430e-bfe5-79600ccf15c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.677528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd883-13ab-4f95-a426-d87caf66cb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.677764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bd4e5-a683-430e-bfe5-79600ccf15c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.679649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bd4e5-a683-430e-bfe5-79600ccf15c4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.679751 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd883-13ab-4f95-a426-d87caf66cb6f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.701372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 803/1585] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.702217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd4e5-a683-430e-bfe5-79600ccf15c4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.704723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 783/1586] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.705651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd883-13ab-4f95-a426-d87caf66cb6f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.715652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd883-13ab-4f95-a426-d87caf66cb6f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.715827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd4e5-a683-430e-bfe5-79600ccf15c4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.720174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f51ec-e719-47c2-840e-a964acd49513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.720643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbe874-fbb2-4d58-9b44-a8f8987cfd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.720825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f51ec-e719-47c2-840e-a964acd49513 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.721147 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f51ec-e719-47c2-840e-a964acd49513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.721422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f51ec-e719-47c2-840e-a964acd49513 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.721536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe874-fbb2-4d58-9b44-a8f8987cfd5e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.721774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe874-fbb2-4d58-9b44-a8f8987cfd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.722052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe874-fbb2-4d58-9b44-a8f8987cfd5e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.722219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f51ec-e719-47c2-840e-a964acd49513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.722728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbe874-fbb2-4d58-9b44-a8f8987cfd5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.724143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f51ec-e719-47c2-840e-a964acd49513 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.724708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbe874-fbb2-4d58-9b44-a8f8987cfd5e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.745175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 784/1587] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.749012 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f51ec-e719-47c2-840e-a964acd49513 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.749494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 804/1588] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.752805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbe874-fbb2-4d58-9b44-a8f8987cfd5e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.758830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f51ec-e719-47c2-840e-a964acd49513 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.762260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbe874-fbb2-4d58-9b44-a8f8987cfd5e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.763300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085f7f-86b0-4469-8caa-ed8f0e22df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.763946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085f7f-86b0-4469-8caa-ed8f0e22df56 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.764228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085f7f-86b0-4469-8caa-ed8f0e22df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.764514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085f7f-86b0-4469-8caa-ed8f0e22df56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.765185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64085f7f-86b0-4469-8caa-ed8f0e22df56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.767021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59610cda-4c9e-45f9-8f41-4058a8944a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.767161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64085f7f-86b0-4469-8caa-ed8f0e22df56 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.767741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59610cda-4c9e-45f9-8f41-4058a8944a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.768088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59610cda-4c9e-45f9-8f41-4058a8944a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.768449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59610cda-4c9e-45f9-8f41-4058a8944a48 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.769175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59610cda-4c9e-45f9-8f41-4058a8944a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.771213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59610cda-4c9e-45f9-8f41-4058a8944a48 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.804054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 805/1589] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.804742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59610cda-4c9e-45f9-8f41-4058a8944a48 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.807256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 785/1590] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.808178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085f7f-86b0-4469-8caa-ed8f0e22df56 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.816571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59610cda-4c9e-45f9-8f41-4058a8944a48 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.869776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085f7f-86b0-4469-8caa-ed8f0e22df56 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.874535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924324ac-83f7-4c71-b131-49243f9979ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.875199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924324ac-83f7-4c71-b131-49243f9979ae admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.875478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924324ac-83f7-4c71-b131-49243f9979ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.875748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924324ac-83f7-4c71-b131-49243f9979ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.876475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924324ac-83f7-4c71-b131-49243f9979ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.878113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924324ac-83f7-4c71-b131-49243f9979ae admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.878307 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f540e-ee7b-4919-921d-079306668df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.879153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f540e-ee7b-4919-921d-079306668df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.879446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f540e-ee7b-4919-921d-079306668df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.879713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f540e-ee7b-4919-921d-079306668df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.880375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f540e-ee7b-4919-921d-079306668df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.882627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f540e-ee7b-4919-921d-079306668df8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.887973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 786/1591] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:53.891557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924324ac-83f7-4c71-b131-49243f9979ae admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.901115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924324ac-83f7-4c71-b131-49243f9979ae admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.905683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 806/1592] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:53.906181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74403a0-bfd6-4d9a-9876-947e7d7e4881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.906677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f540e-ee7b-4919-921d-079306668df8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.907253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74403a0-bfd6-4d9a-9876-947e7d7e4881 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.907738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74403a0-bfd6-4d9a-9876-947e7d7e4881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.908231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74403a0-bfd6-4d9a-9876-947e7d7e4881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.909165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74403a0-bfd6-4d9a-9876-947e7d7e4881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.911355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74403a0-bfd6-4d9a-9876-947e7d7e4881 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.916335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f540e-ee7b-4919-921d-079306668df8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.921334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9cbeb-beea-42d2-b731-7c2316ad67a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.922035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9cbeb-beea-42d2-b731-7c2316ad67a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.922311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9cbeb-beea-42d2-b731-7c2316ad67a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.922574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9cbeb-beea-42d2-b731-7c2316ad67a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.923304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9cbeb-beea-42d2-b731-7c2316ad67a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.924870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9cbeb-beea-42d2-b731-7c2316ad67a7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.926323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 787/1593] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:53.927760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74403a0-bfd6-4d9a-9876-947e7d7e4881 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.934951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 807/1594] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:53.934951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9cbeb-beea-42d2-b731-7c2316ad67a7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.945184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74403a0-bfd6-4d9a-9876-947e7d7e4881 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.945757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9cbeb-beea-42d2-b731-7c2316ad67a7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.949752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c7a18-e4c3-4239-9249-e84cef31bbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.950547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7a18-e4c3-4239-9249-e84cef31bbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.950796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65024240-c4b1-4bf8-ba0d-3849e36a5408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.950914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7a18-e4c3-4239-9249-e84cef31bbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.951090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7a18-e4c3-4239-9249-e84cef31bbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.951595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65024240-c4b1-4bf8-ba0d-3849e36a5408 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.951812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c7a18-e4c3-4239-9249-e84cef31bbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.952095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65024240-c4b1-4bf8-ba0d-3849e36a5408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.952427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65024240-c4b1-4bf8-ba0d-3849e36a5408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.953217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65024240-c4b1-4bf8-ba0d-3849e36a5408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.953575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c7a18-e4c3-4239-9249-e84cef31bbd5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.954956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65024240-c4b1-4bf8-ba0d-3849e36a5408 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.965327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 788/1595] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:53.966054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c7a18-e4c3-4239-9249-e84cef31bbd5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.969000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 808/1596] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:53.969747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65024240-c4b1-4bf8-ba0d-3849e36a5408 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:53.977146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c7a18-e4c3-4239-9249-e84cef31bbd5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.978998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65024240-c4b1-4bf8-ba0d-3849e36a5408 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:53.982784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3985a-2254-40da-a371-6a7937652616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.983505 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949cd9e-a540-41cb-8b46-009b20db919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:53.984010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3985a-2254-40da-a371-6a7937652616 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.984128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cd9e-a540-41cb-8b46-009b20db919a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:53.984404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cd9e-a540-41cb-8b46-009b20db919a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.984674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cd9e-a540-41cb-8b46-009b20db919a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.984988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3985a-2254-40da-a371-6a7937652616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:53.985383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949cd9e-a540-41cb-8b46-009b20db919a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.985707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3985a-2254-40da-a371-6a7937652616 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:53.986579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3985a-2254-40da-a371-6a7937652616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:53.987017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949cd9e-a540-41cb-8b46-009b20db919a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.988995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3985a-2254-40da-a371-6a7937652616 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:53.996612 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 809/1597] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:53.997347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949cd9e-a540-41cb-8b46-009b20db919a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.006517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949cd9e-a540-41cb-8b46-009b20db919a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.011233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81df0-5939-4624-8895-c6cbe5af4b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.011871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81df0-5939-4624-8895-c6cbe5af4b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.012151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81df0-5939-4624-8895-c6cbe5af4b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.012446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81df0-5939-4624-8895-c6cbe5af4b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.013151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e81df0-5939-4624-8895-c6cbe5af4b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.015113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e81df0-5939-4624-8895-c6cbe5af4b5c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.018539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 789/1598] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:53 2022] POST /identity/v3/users => generated 288 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:54.018539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3985a-2254-40da-a371-6a7937652616 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.027348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 810/1599] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:54.028235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81df0-5939-4624-8895-c6cbe5af4b5c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.039228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3985a-2254-40da-a371-6a7937652616 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.043199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81df0-5939-4624-8895-c6cbe5af4b5c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.045039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d57e3d-0cf0-4e57-b66f-1e9c73969dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.045745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d57e3d-0cf0-4e57-b66f-1e9c73969dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.046344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d57e3d-0cf0-4e57-b66f-1e9c73969dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.046610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d57e3d-0cf0-4e57-b66f-1e9c73969dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.047338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d57e3d-0cf0-4e57-b66f-1e9c73969dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.049063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d57e3d-0cf0-4e57-b66f-1e9c73969dc6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.049233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4348-36c1-4f5f-86d3-fa2dc0d41e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.050037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4348-36c1-4f5f-86d3-fa2dc0d41e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.050412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4348-36c1-4f5f-86d3-fa2dc0d41e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.050783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4348-36c1-4f5f-86d3-fa2dc0d41e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.051600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee4348-36c1-4f5f-86d3-fa2dc0d41e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.053435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee4348-36c1-4f5f-86d3-fa2dc0d41e8f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.062644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 790/1600] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:54.063360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d57e3d-0cf0-4e57-b66f-1e9c73969dc6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.068615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 811/1601] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:54.068615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4348-36c1-4f5f-86d3-fa2dc0d41e8f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.073057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d57e3d-0cf0-4e57-b66f-1e9c73969dc6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.077534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ac10-fcaf-44d7-bcab-9a780a56b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.078221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ac10-fcaf-44d7-bcab-9a780a56b285 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.078342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4348-36c1-4f5f-86d3-fa2dc0d41e8f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.078502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ac10-fcaf-44d7-bcab-9a780a56b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.078776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ac10-fcaf-44d7-bcab-9a780a56b285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.079683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ac10-fcaf-44d7-bcab-9a780a56b285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.081202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ac10-fcaf-44d7-bcab-9a780a56b285 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.082853 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8669e-2618-4608-bb3e-f20f189f97b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.083498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8669e-2618-4608-bb3e-f20f189f97b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.083775 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8669e-2618-4608-bb3e-f20f189f97b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.084099 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8669e-2618-4608-bb3e-f20f189f97b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.084812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8669e-2618-4608-bb3e-f20f189f97b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.086462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8669e-2618-4608-bb3e-f20f189f97b5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.091123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 791/1602] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:54.091886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ac10-fcaf-44d7-bcab-9a780a56b285 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.096323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 812/1603] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:54.097100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8669e-2618-4608-bb3e-f20f189f97b5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.103988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ac10-fcaf-44d7-bcab-9a780a56b285 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.106258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8669e-2618-4608-bb3e-f20f189f97b5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.108502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423876a9-da1a-4b88-a83c-1ae284f9e7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.109401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423876a9-da1a-4b88-a83c-1ae284f9e7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.109722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423876a9-da1a-4b88-a83c-1ae284f9e7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.109996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423876a9-da1a-4b88-a83c-1ae284f9e7b1 admin admin] PATH_INFO: `/v3/projects/954fb79bc14043c5a136989ab363e7fd/users/565fbf46701f48b383d24614caf7b576/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.110941 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6649ec-e1b3-4038-b760-d1df7efd3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.111651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6649ec-e1b3-4038-b760-d1df7efd3bac admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.111997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6649ec-e1b3-4038-b760-d1df7efd3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.112334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6649ec-e1b3-4038-b760-d1df7efd3bac admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.113106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6649ec-e1b3-4038-b760-d1df7efd3bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.114805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6649ec-e1b3-4038-b760-d1df7efd3bac admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.124179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423876a9-da1a-4b88-a83c-1ae284f9e7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954fb79bc14043c5a136989ab363e7fd, user_id=565fbf46701f48b383d24614caf7b576, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.124792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 813/1604] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:54.125645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6649ec-e1b3-4038-b760-d1df7efd3bac admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.127579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423876a9-da1a-4b88-a83c-1ae284f9e7b1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.135314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6649ec-e1b3-4038-b760-d1df7efd3bac admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.139952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5437d77-a513-41ba-911f-3e8867e81cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.140570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437d77-a513-41ba-911f-3e8867e81cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.140844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437d77-a513-41ba-911f-3e8867e81cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.141118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437d77-a513-41ba-911f-3e8867e81cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.141862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5437d77-a513-41ba-911f-3e8867e81cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.143568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 792/1605] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:54 2022] PUT /identity/v3/projects/954fb79bc14043c5a136989ab363e7fd/users/565fbf46701f48b383d24614caf7b576/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:54.143772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5437d77-a513-41ba-911f-3e8867e81cb1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.146422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423876a9-da1a-4b88-a83c-1ae284f9e7b1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.157579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 814/1606] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:54.157579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5437d77-a513-41ba-911f-3e8867e81cb1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.167586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5437d77-a513-41ba-911f-3e8867e81cb1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.213459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423876a9-da1a-4b88-a83c-1ae284f9e7b1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.218208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310233a-1dd5-403b-aa07-578f044ce6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.219291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310233a-1dd5-403b-aa07-578f044ce6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.219764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310233a-1dd5-403b-aa07-578f044ce6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.220203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310233a-1dd5-403b-aa07-578f044ce6b4 admin admin] PATH_INFO: `/v3/projects/2274077667c34bfe97aef60336abd908/users/b52d8bc746404982a586f3fdbee45348/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.223698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090469-3b5a-4b40-8fe4-35416666b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.224596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090469-3b5a-4b40-8fe4-35416666b9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.224879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090469-3b5a-4b40-8fe4-35416666b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.225152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090469-3b5a-4b40-8fe4-35416666b9e8 admin admin] PATH_INFO: `/v3/projects/1eddf9ae85b940b8bd556f4cf66c0b79/users/c482d82afb734e10a5a11070fcb5f736/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.234500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310233a-1dd5-403b-aa07-578f044ce6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2274077667c34bfe97aef60336abd908, user_id=b52d8bc746404982a586f3fdbee45348, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.237145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310233a-1dd5-403b-aa07-578f044ce6b4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.240280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090469-3b5a-4b40-8fe4-35416666b9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eddf9ae85b940b8bd556f4cf66c0b79, user_id=c482d82afb734e10a5a11070fcb5f736, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.242892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090469-3b5a-4b40-8fe4-35416666b9e8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.253492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 793/1607] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:54 2022] PUT /identity/v3/projects/2274077667c34bfe97aef60336abd908/users/b52d8bc746404982a586f3fdbee45348/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:54.254806 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83583-b2b4-4faf-9a65-8ab76ffb2428 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.255085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83583-b2b4-4faf-9a65-8ab76ffb2428 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.255360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83583-b2b4-4faf-9a65-8ab76ffb2428 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.256644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 794/1608] 10.222.0.58 () {54 vars in 961 bytes} [Mon May 16 17:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:39:54.257308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83583-b2b4-4faf-9a65-8ab76ffb2428 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.261036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 815/1609] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:54 2022] PUT /identity/v3/projects/1eddf9ae85b940b8bd556f4cf66c0b79/users/c482d82afb734e10a5a11070fcb5f736/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:54.265752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090469-3b5a-4b40-8fe4-35416666b9e8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.323226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83583-b2b4-4faf-9a65-8ab76ffb2428 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.326119 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090469-3b5a-4b40-8fe4-35416666b9e8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.327811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e44d9-fa2e-43c3-abec-d6cd9a4798f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.328885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e44d9-fa2e-43c3-abec-d6cd9a4798f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.329006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e44d9-fa2e-43c3-abec-d6cd9a4798f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.329228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e44d9-fa2e-43c3-abec-d6cd9a4798f4 admin admin] PATH_INFO: `/v3/projects/856203f959084015950211c4e61f8cbf/users/93f22220c9f144ef92b0cd0bf90c23df/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.331524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e811b3-2c23-4021-9de3-37173b782ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.332433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e811b3-2c23-4021-9de3-37173b782ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.332713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e811b3-2c23-4021-9de3-37173b782ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.332985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e811b3-2c23-4021-9de3-37173b782ae8 admin admin] PATH_INFO: `/v3/projects/94fe0f6c2e964969bd46781356d2539e/users/2b97874877694c3ea7cbc1af2a848b2a/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.343380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e44d9-fa2e-43c3-abec-d6cd9a4798f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856203f959084015950211c4e61f8cbf, user_id=93f22220c9f144ef92b0cd0bf90c23df, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.346302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e44d9-fa2e-43c3-abec-d6cd9a4798f4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.348084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e811b3-2c23-4021-9de3-37173b782ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fe0f6c2e964969bd46781356d2539e, user_id=2b97874877694c3ea7cbc1af2a848b2a, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.350831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e811b3-2c23-4021-9de3-37173b782ae8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.360418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 795/1610] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:54 2022] PUT /identity/v3/projects/856203f959084015950211c4e61f8cbf/users/93f22220c9f144ef92b0cd0bf90c23df/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:54.362316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e44d9-fa2e-43c3-abec-d6cd9a4798f4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.364621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 816/1611] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:54 2022] PUT /identity/v3/projects/94fe0f6c2e964969bd46781356d2539e/users/2b97874877694c3ea7cbc1af2a848b2a/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:54.366198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098f2d-06ea-47ea-8ee1-77075443d077 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.366590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098f2d-06ea-47ea-8ee1-77075443d077 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.366984 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098f2d-06ea-47ea-8ee1-77075443d077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.383670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-28098f2d-06ea-47ea-8ee1-77075443d077 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:54.385040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-28098f2d-06ea-47ea-8ee1-77075443d077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:54.421274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e44d9-fa2e-43c3-abec-d6cd9a4798f4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.439578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 817/1612] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:54.440368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28098f2d-06ea-47ea-8ee1-77075443d077 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.449827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28098f2d-06ea-47ea-8ee1-77075443d077 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.454272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318351a0-18b4-41aa-aac1-a7060cfb6a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.455128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318351a0-18b4-41aa-aac1-a7060cfb6a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.455403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318351a0-18b4-41aa-aac1-a7060cfb6a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.455675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318351a0-18b4-41aa-aac1-a7060cfb6a1d admin admin] PATH_INFO: `/v3/projects/80c60c24806542e889c070d519172e79/users/6838738598ce4d2186e7c0b6547868f6/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.469917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318351a0-18b4-41aa-aac1-a7060cfb6a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c60c24806542e889c070d519172e79, user_id=6838738598ce4d2186e7c0b6547868f6, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.472600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318351a0-18b4-41aa-aac1-a7060cfb6a1d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.479669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffcb78-39a5-4c81-bcd9-9c693126599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.480580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcb78-39a5-4c81-bcd9-9c693126599a admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.480896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcb78-39a5-4c81-bcd9-9c693126599a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.481174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcb78-39a5-4c81-bcd9-9c693126599a admin admin] PATH_INFO: `/v3/projects/1152b943ac90453e8962c234ce933583/users/d9be85e4309a44a1a43b24e27e92f372/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.485907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 818/1613] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:54 2022] PUT /identity/v3/projects/80c60c24806542e889c070d519172e79/users/6838738598ce4d2186e7c0b6547868f6/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:54.487449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f813e-96ad-4333-abf7-cfa1668640af None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.487732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f813e-96ad-4333-abf7-cfa1668640af None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.488001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f813e-96ad-4333-abf7-cfa1668640af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.495701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffcb78-39a5-4c81-bcd9-9c693126599a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1152b943ac90453e8962c234ce933583, user_id=d9be85e4309a44a1a43b24e27e92f372, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.498408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffcb78-39a5-4c81-bcd9-9c693126599a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.504618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f37f813e-96ad-4333-abf7-cfa1668640af None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:54.505835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f37f813e-96ad-4333-abf7-cfa1668640af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:54.512042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 796/1614] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:54 2022] PUT /identity/v3/projects/1152b943ac90453e8962c234ce933583/users/d9be85e4309a44a1a43b24e27e92f372/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:54.513290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65097d3-3173-4f16-afe4-9a60077808ff None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.513596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65097d3-3173-4f16-afe4-9a60077808ff None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.513875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65097d3-3173-4f16-afe4-9a60077808ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.538425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d65097d3-3173-4f16-afe4-9a60077808ff None None] MFA Rules not processed for user `b52d8bc746404982a586f3fdbee45348`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:54.539636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d65097d3-3173-4f16-afe4-9a60077808ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:54.570133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 819/1615] 10.222.0.58 () {58 vars in 1058 bytes} [Mon May 16 17:39:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:54.571754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39460-97f5-49c4-ac4a-efdb33e7b9df None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.571754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39460-97f5-49c4-ac4a-efdb33e7b9df None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.571992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39460-97f5-49c4-ac4a-efdb33e7b9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.589737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9bc39460-97f5-49c4-ac4a-efdb33e7b9df None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:54.590933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9bc39460-97f5-49c4-ac4a-efdb33e7b9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:54.600983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 797/1616] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:54.602286 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee642bb-7403-4f51-9657-f209f08a9040 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.602572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee642bb-7403-4f51-9657-f209f08a9040 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.602830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee642bb-7403-4f51-9657-f209f08a9040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.628297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2ee642bb-7403-4f51-9657-f209f08a9040 None None] MFA Rules not processed for user `93f22220c9f144ef92b0cd0bf90c23df`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:54.629478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2ee642bb-7403-4f51-9657-f209f08a9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:54.647315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 820/1617] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:54.648592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab93f43-08ac-4c64-8dad-52c098283ed8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.648879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab93f43-08ac-4c64-8dad-52c098283ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.649155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab93f43-08ac-4c64-8dad-52c098283ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.674375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bab93f43-08ac-4c64-8dad-52c098283ed8 None None] MFA Rules not processed for user `2b97874877694c3ea7cbc1af2a848b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:54.675551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bab93f43-08ac-4c64-8dad-52c098283ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:54.700497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 798/1618] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:54.705029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee642bb-7403-4f51-9657-f209f08a9040 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.705029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2ee642bb-7403-4f51-9657-f209f08a9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:54.750726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 821/1619] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:54.755344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1c39-efcf-42df-b30c-12bf48668c3d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.755344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1c39-efcf-42df-b30c-12bf48668c3d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.755344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1c39-efcf-42df-b30c-12bf48668c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.760770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee642bb-7403-4f51-9657-f209f08a9040 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.764456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d4589-c7a3-46f5-94e1-a7fa39553dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.765097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4589-c7a3-46f5-94e1-a7fa39553dab service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.765371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4589-c7a3-46f5-94e1-a7fa39553dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.765666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4589-c7a3-46f5-94e1-a7fa39553dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.771074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a8cd1c39-efcf-42df-b30c-12bf48668c3d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:54.772323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a8cd1c39-efcf-42df-b30c-12bf48668c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:54.774820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d4589-c7a3-46f5-94e1-a7fa39553dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.776276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d4589-c7a3-46f5-94e1-a7fa39553dab service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.780951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 822/1620] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:54.782085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1c39-efcf-42df-b30c-12bf48668c3d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.787047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 799/1621] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:54.788456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431139e-a2da-45ff-91a5-edb064ca502d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.788672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431139e-a2da-45ff-91a5-edb064ca502d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.788950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431139e-a2da-45ff-91a5-edb064ca502d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.790279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 800/1622] 10.222.0.58 () {54 vars in 912 bytes} [Mon May 16 17:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:39:54.790967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431139e-a2da-45ff-91a5-edb064ca502d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.794028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1c39-efcf-42df-b30c-12bf48668c3d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.800850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c5a3f-3308-4c4e-b1c7-801e9060557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.801561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c5a3f-3308-4c4e-b1c7-801e9060557a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.801892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c5a3f-3308-4c4e-b1c7-801e9060557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.802429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c5a3f-3308-4c4e-b1c7-801e9060557a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.803243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c5a3f-3308-4c4e-b1c7-801e9060557a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.803576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431139e-a2da-45ff-91a5-edb064ca502d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.804918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c5a3f-3308-4c4e-b1c7-801e9060557a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.809170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fba100-3f54-4eba-be9b-b46fff86b942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.809909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fba100-3f54-4eba-be9b-b46fff86b942 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.810189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fba100-3f54-4eba-be9b-b46fff86b942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.810514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fba100-3f54-4eba-be9b-b46fff86b942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.811217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fba100-3f54-4eba-be9b-b46fff86b942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.813246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fba100-3f54-4eba-be9b-b46fff86b942 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.816033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 823/1623] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:54.816726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c5a3f-3308-4c4e-b1c7-801e9060557a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.827879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c5a3f-3308-4c4e-b1c7-801e9060557a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.831866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18e55-4695-4d9f-8af3-17bce7dc54ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.832613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18e55-4695-4d9f-8af3-17bce7dc54ee service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.832963 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18e55-4695-4d9f-8af3-17bce7dc54ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.833410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18e55-4695-4d9f-8af3-17bce7dc54ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.844058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e18e55-4695-4d9f-8af3-17bce7dc54ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:54.847490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 801/1624] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:39:54 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:54.847623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e18e55-4695-4d9f-8af3-17bce7dc54ee service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:54.847737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fba100-3f54-4eba-be9b-b46fff86b942 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.856230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 824/1625] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:54.856969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18e55-4695-4d9f-8af3-17bce7dc54ee service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:54.873224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18e55-4695-4d9f-8af3-17bce7dc54ee service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.934272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fba100-3f54-4eba-be9b-b46fff86b942 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:54.945180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68829eae-3113-40ce-9b2e-4bea1aca3c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.946584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829eae-3113-40ce-9b2e-4bea1aca3c9d service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.947037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829eae-3113-40ce-9b2e-4bea1aca3c9d service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.947528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829eae-3113-40ce-9b2e-4bea1aca3c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:54.963241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a50328-dce8-424b-b559-da2f16b5884b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:54.964010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50328-dce8-424b-b559-da2f16b5884b service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:54.964310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50328-dce8-424b-b559-da2f16b5884b service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:54.964557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50328-dce8-424b-b559-da2f16b5884b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.036093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a50328-dce8-424b-b559-da2f16b5884b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.036093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a50328-dce8-424b-b559-da2f16b5884b service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.038271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68829eae-3113-40ce-9b2e-4bea1aca3c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.040181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68829eae-3113-40ce-9b2e-4bea1aca3c9d service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.049584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 825/1626] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:55.051773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668caa5e-6b32-4bd5-a4eb-f2b62dfc9490 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.053063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668caa5e-6b32-4bd5-a4eb-f2b62dfc9490 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.053536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668caa5e-6b32-4bd5-a4eb-f2b62dfc9490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.055514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 802/1627] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:55.056953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68829eae-3113-40ce-9b2e-4bea1aca3c9d service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.072467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68829eae-3113-40ce-9b2e-4bea1aca3c9d service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.075300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-668caa5e-6b32-4bd5-a4eb-f2b62dfc9490 None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:55.076767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-668caa5e-6b32-4bd5-a4eb-f2b62dfc9490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:55.081323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ad75a-55f7-4bc7-8bab-3c77947e2a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.082568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ad75a-55f7-4bc7-8bab-3c77947e2a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.083013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ad75a-55f7-4bc7-8bab-3c77947e2a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.084037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ad75a-55f7-4bc7-8bab-3c77947e2a54 admin admin] PATH_INFO: `/v3/projects/1152b943ac90453e8962c234ce933583/users/d9be85e4309a44a1a43b24e27e92f372/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.090771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ad75a-55f7-4bc7-8bab-3c77947e2a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1152b943ac90453e8962c234ce933583, user_id=d9be85e4309a44a1a43b24e27e92f372, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.090971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 826/1628] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:55.090971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668caa5e-6b32-4bd5-a4eb-f2b62dfc9490 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.099017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ad75a-55f7-4bc7-8bab-3c77947e2a54 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.100143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668caa5e-6b32-4bd5-a4eb-f2b62dfc9490 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.108324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29ae0-f83a-451d-8b01-c4270f5f1b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.110317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29ae0-f83a-451d-8b01-c4270f5f1b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.110600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29ae0-f83a-451d-8b01-c4270f5f1b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.110872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29ae0-f83a-451d-8b01-c4270f5f1b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.113791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29ae0-f83a-451d-8b01-c4270f5f1b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.115823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29ae0-f83a-451d-8b01-c4270f5f1b2f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.129661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 803/1629] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:55 2022] PUT /identity/v3/projects/1152b943ac90453e8962c234ce933583/users/d9be85e4309a44a1a43b24e27e92f372/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:55.131296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ad75a-55f7-4bc7-8bab-3c77947e2a54 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.155886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 827/1630] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:39:55 2022] POST /identity/v3/users => generated 292 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:39:55.158308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868af157-a571-4699-b538-c0d7a8251d8e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.158836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868af157-a571-4699-b538-c0d7a8251d8e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.159257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868af157-a571-4699-b538-c0d7a8251d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.207928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-868af157-a571-4699-b538-c0d7a8251d8e None None] MFA Rules not processed for user `d9be85e4309a44a1a43b24e27e92f372`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:55.209479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-868af157-a571-4699-b538-c0d7a8251d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:55.216427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ad75a-55f7-4bc7-8bab-3c77947e2a54 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.222937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0eaf1-cbc6-4c9b-ad02-7dfafe8b3643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.224092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0eaf1-cbc6-4c9b-ad02-7dfafe8b3643 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.224601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0eaf1-cbc6-4c9b-ad02-7dfafe8b3643 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.224973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0eaf1-cbc6-4c9b-ad02-7dfafe8b3643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.320714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 828/1631] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:55.322278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc468a-17b3-4731-aaa0-305386a7f236 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.322564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc468a-17b3-4731-aaa0-305386a7f236 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.322839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc468a-17b3-4731-aaa0-305386a7f236 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.330300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 829/1632] 10.222.0.58 () {54 vars in 912 bytes} [Mon May 16 17:39:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:39:55.331432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc468a-17b3-4731-aaa0-305386a7f236 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.391141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0eaf1-cbc6-4c9b-ad02-7dfafe8b3643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.392756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0eaf1-cbc6-4c9b-ad02-7dfafe8b3643 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.413036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 804/1633] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:55.416197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec922e-24b5-4fee-9e71-d496b6f6723c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.416619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec922e-24b5-4fee-9e71-d496b6f6723c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.416992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec922e-24b5-4fee-9e71-d496b6f6723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.451906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-18ec922e-24b5-4fee-9e71-d496b6f6723c None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:55.454002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-18ec922e-24b5-4fee-9e71-d496b6f6723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:55.461589 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc468a-17b3-4731-aaa0-305386a7f236 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.472947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705ca4-4907-4b34-971b-0afe6e9e24e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.473654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705ca4-4907-4b34-971b-0afe6e9e24e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.473939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705ca4-4907-4b34-971b-0afe6e9e24e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.474216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac705ca4-4907-4b34-971b-0afe6e9e24e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.474831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 805/1634] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:55.475068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705ca4-4907-4b34-971b-0afe6e9e24e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.476673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac705ca4-4907-4b34-971b-0afe6e9e24e6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.477525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec922e-24b5-4fee-9e71-d496b6f6723c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.495968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec922e-24b5-4fee-9e71-d496b6f6723c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.505042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaec2fd-24eb-4b48-9049-81292818b9e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.505451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaec2fd-24eb-4b48-9049-81292818b9e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.505451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaec2fd-24eb-4b48-9049-81292818b9e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.505898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaec2fd-24eb-4b48-9049-81292818b9e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.513181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 830/1635] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:55.514951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705ca4-4907-4b34-971b-0afe6e9e24e6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.526469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaec2fd-24eb-4b48-9049-81292818b9e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.527820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaec2fd-24eb-4b48-9049-81292818b9e8 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.556206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac705ca4-4907-4b34-971b-0afe6e9e24e6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.564042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 806/1636] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:55.570266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e18ab-9ddf-402a-8393-5d82abb926d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.572737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e18ab-9ddf-402a-8393-5d82abb926d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.573362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e18ab-9ddf-402a-8393-5d82abb926d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.574026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e18ab-9ddf-402a-8393-5d82abb926d3 admin admin] PATH_INFO: `/v3/projects/c1f07220112d431d8e00dea4ec2bd0e6/users/389c851de0f94f9d864f4302f2426279/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.626961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e18ab-9ddf-402a-8393-5d82abb926d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f07220112d431d8e00dea4ec2bd0e6, user_id=389c851de0f94f9d864f4302f2426279, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.633078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaec2fd-24eb-4b48-9049-81292818b9e8 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.640065 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e18ab-9ddf-402a-8393-5d82abb926d3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.648573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaec2fd-24eb-4b48-9049-81292818b9e8 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.654614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5abc96-da2b-4a26-bff5-a8d37ae66f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.655562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abc96-da2b-4a26-bff5-a8d37ae66f79 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.656010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abc96-da2b-4a26-bff5-a8d37ae66f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.656350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abc96-da2b-4a26-bff5-a8d37ae66f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.668434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5abc96-da2b-4a26-bff5-a8d37ae66f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.669895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 831/1637] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:55 2022] PUT /identity/v3/projects/c1f07220112d431d8e00dea4ec2bd0e6/users/389c851de0f94f9d864f4302f2426279/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:55.671250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e18ab-9ddf-402a-8393-5d82abb926d3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.673842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5abc96-da2b-4a26-bff5-a8d37ae66f79 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.699812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 807/1638] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:39:55.702410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5abc96-da2b-4a26-bff5-a8d37ae66f79 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:55.732351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5abc96-da2b-4a26-bff5-a8d37ae66f79 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.801415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e18ab-9ddf-402a-8393-5d82abb926d3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:55.817339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dab3e-b4f9-463f-b84c-b3143edfcdf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.818063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dab3e-b4f9-463f-b84c-b3143edfcdf9 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.818440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dab3e-b4f9-463f-b84c-b3143edfcdf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.818724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dab3e-b4f9-463f-b84c-b3143edfcdf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.938438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3949743-087e-4a3a-974e-7ba78411155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:55.939622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3949743-087e-4a3a-974e-7ba78411155c admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.941810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3949743-087e-4a3a-974e-7ba78411155c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.942507 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3949743-087e-4a3a-974e-7ba78411155c admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.947388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3949743-087e-4a3a-974e-7ba78411155c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.949298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3949743-087e-4a3a-974e-7ba78411155c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:55.963512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 808/1639] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:39:55.967410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976366c-0d52-4b18-b6f3-f16e2a6ad9e6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:55.968130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976366c-0d52-4b18-b6f3-f16e2a6ad9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:55.968629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976366c-0d52-4b18-b6f3-f16e2a6ad9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:55.989829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dab3e-b4f9-463f-b84c-b3143edfcdf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:55.995175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dab3e-b4f9-463f-b84c-b3143edfcdf9 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:56.028959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 832/1640] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:56.029146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0976366c-0d52-4b18-b6f3-f16e2a6ad9e6 None None] MFA Rules not processed for user `565fbf46701f48b383d24614caf7b576`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:56.030748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0976366c-0d52-4b18-b6f3-f16e2a6ad9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:56.031714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dab3e-b4f9-463f-b84c-b3143edfcdf9 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:56.066595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dab3e-b4f9-463f-b84c-b3143edfcdf9 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:56.081211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33036ce-eb1f-4145-93cc-ebb4f081b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:56.082337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33036ce-eb1f-4145-93cc-ebb4f081b350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:56.082620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33036ce-eb1f-4145-93cc-ebb4f081b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:56.082899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33036ce-eb1f-4145-93cc-ebb4f081b350 admin admin] PATH_INFO: `/v3/projects/c1f07220112d431d8e00dea4ec2bd0e6/users/389c851de0f94f9d864f4302f2426279/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:56.089225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33036ce-eb1f-4145-93cc-ebb4f081b350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f07220112d431d8e00dea4ec2bd0e6, user_id=389c851de0f94f9d864f4302f2426279, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:56.091945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33036ce-eb1f-4145-93cc-ebb4f081b350 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:56.126353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 833/1641] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:39:56 2022] PUT /identity/v3/projects/c1f07220112d431d8e00dea4ec2bd0e6/users/389c851de0f94f9d864f4302f2426279/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:56.128536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bbc3c-1899-4847-91fb-68a2256b39d3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:56.128869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bbc3c-1899-4847-91fb-68a2256b39d3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:56.129231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bbc3c-1899-4847-91fb-68a2256b39d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:56.162881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a30bbc3c-1899-4847-91fb-68a2256b39d3 None None] MFA Rules not processed for user `389c851de0f94f9d864f4302f2426279`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:56.164148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a30bbc3c-1899-4847-91fb-68a2256b39d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:56.183829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 809/1642] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:56.195048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40feb25-354a-464a-b977-b670cf1b2c01 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:56.195606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40feb25-354a-464a-b977-b670cf1b2c01 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:56.196053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40feb25-354a-464a-b977-b670cf1b2c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:56.253067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f40feb25-354a-464a-b977-b670cf1b2c01 None None] MFA Rules not processed for user `565fbf46701f48b383d24614caf7b576`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:56.255420 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f40feb25-354a-464a-b977-b670cf1b2c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:56.285844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 834/1643] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:56.393591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 810/1644] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:39:56.810265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bbc3c-1899-4847-91fb-68a2256b39d3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:56.905374 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bbc3c-1899-4847-91fb-68a2256b39d3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:56.915137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc488-6a50-4bd0-9dc3-4059105dd2d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:56.917774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc488-6a50-4bd0-9dc3-4059105dd2d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:56.921342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc488-6a50-4bd0-9dc3-4059105dd2d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:56.921689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc488-6a50-4bd0-9dc3-4059105dd2d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:56.952331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc488-6a50-4bd0-9dc3-4059105dd2d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:56.954220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc488-6a50-4bd0-9dc3-4059105dd2d6 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:56.983034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 835/1645] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:57.122922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40feb25-354a-464a-b977-b670cf1b2c01 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:57.241980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40feb25-354a-464a-b977-b670cf1b2c01 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:57.263507 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714d80-7fa9-4f0d-a408-be1c2fc6dab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:57.264267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714d80-7fa9-4f0d-a408-be1c2fc6dab1 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:57.264851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714d80-7fa9-4f0d-a408-be1c2fc6dab1 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:57.265192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714d80-7fa9-4f0d-a408-be1c2fc6dab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:57.281677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e714d80-7fa9-4f0d-a408-be1c2fc6dab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:57.288007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e714d80-7fa9-4f0d-a408-be1c2fc6dab1 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:57.312114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 811/1646] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:57.684651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc488-6a50-4bd0-9dc3-4059105dd2d6 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:57.766631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc488-6a50-4bd0-9dc3-4059105dd2d6 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:57.772711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:57.774103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:57.774601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:57.775130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] PATH_INFO: `/v3/users/b0ca7baf0d3f450ba7e582c3c303a8f5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:57.776621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ca7baf0d3f450ba7e582c3c303a8f5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:57.778226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:39:57.778226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 16 17:39:57.778226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: May 16 17:39:57.781115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:57.812958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714d80-7fa9-4f0d-a408-be1c2fc6dab1 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:57.830943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714d80-7fa9-4f0d-a408-be1c2fc6dab1 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:57.841769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:57.842790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:57.843166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:57.843654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] PATH_INFO: `/v3/users/8ae5a7cc098f4a9f98d5e09a2095e95d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:57.847780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae5a7cc098f4a9f98d5e09a2095e95d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:57.853136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:57.935383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ca7baf0d3f450ba7e582c3c303a8f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:57.940462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae5a7cc098f4a9f98d5e09a2095e95d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:57.968856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae5a7cc098f4a9f98d5e09a2095e95d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:57.970981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae5a7cc098f4a9f98d5e09a2095e95d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:57.971774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae5a7cc098f4a9f98d5e09a2095e95d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:57.991120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ca7baf0d3f450ba7e582c3c303a8f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:57.991374 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ca7baf0d3f450ba7e582c3c303a8f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.000586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae5a7cc098f4a9f98d5e09a2095e95d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.018798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ca7baf0d3f450ba7e582c3c303a8f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.027084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 812/1647] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:39:57 2022] DELETE /identity/v3/users/8ae5a7cc098f4a9f98d5e09a2095e95d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:39:58.028402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:58.031628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.033491 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7a9c6221-2968-4003-9bae-a51e918d1099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ca7baf0d3f450ba7e582c3c303a8f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.041456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 836/1648] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:39:57 2022] DELETE /identity/v3/users/b0ca7baf0d3f450ba7e582c3c303a8f5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:58.044857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a70c-a234-4f5f-bd48-c7f1941c2ea7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.044857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a70c-a234-4f5f-bd48-c7f1941c2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.044857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a70c-a234-4f5f-bd48-c7f1941c2ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.076572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0cd1a70c-a234-4f5f-bd48-c7f1941c2ea7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:58.080850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0cd1a70c-a234-4f5f-bd48-c7f1941c2ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.161749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b5a7-0b32-449b-8744-f2694e540fcb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:58.182892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 837/1649] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:58.185878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1055c3-4266-42ad-b890-4cec8f427134 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.186752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1055c3-4266-42ad-b890-4cec8f427134 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.187189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1055c3-4266-42ad-b890-4cec8f427134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.214737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4e1055c3-4266-42ad-b890-4cec8f427134 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:58.216226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4e1055c3-4266-42ad-b890-4cec8f427134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.230906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 838/1650] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:58.234065 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e98fa7-aea5-4a89-b27d-a549425dfc8c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.235303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e98fa7-aea5-4a89-b27d-a549425dfc8c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.235829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e98fa7-aea5-4a89-b27d-a549425dfc8c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.237648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 839/1651] 10.222.0.58 () {54 vars in 912 bytes} [Mon May 16 17:39:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:39:58.238632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e98fa7-aea5-4a89-b27d-a549425dfc8c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:58.240991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-11e98fa7-aea5-4a89-b27d-a549425dfc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.246697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:58.247615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.247889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.249862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] PATH_INFO: `/v3/users/b52d8bc746404982a586f3fdbee45348` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.251131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52d8bc746404982a586f3fdbee45348)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:58.258361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:58.337190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52d8bc746404982a586f3fdbee45348'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.352665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e98fa7-aea5-4a89-b27d-a549425dfc8c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:58.355690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52d8bc746404982a586f3fdbee45348'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.356503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52d8bc746404982a586f3fdbee45348'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.357144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52d8bc746404982a586f3fdbee45348'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.361267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af696-d5f4-48f0-b98b-20bc04a986c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:58.362508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af696-d5f4-48f0-b98b-20bc04a986c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.363374 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af696-d5f4-48f0-b98b-20bc04a986c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.363872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af696-d5f4-48f0-b98b-20bc04a986c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.365456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52d8bc746404982a586f3fdbee45348'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:58.368978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ad0af696-d5f4-48f0-b98b-20bc04a986c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.392244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 813/1652] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:39:58 2022] DELETE /identity/v3/users/b52d8bc746404982a586f3fdbee45348 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:58.393541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:58.398820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.404579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af696-d5f4-48f0-b98b-20bc04a986c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:58.406902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af696-d5f4-48f0-b98b-20bc04a986c9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:58.433135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 840/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:58.446756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca963b-7693-411f-8813-b41ef2465fb5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.448915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca963b-7693-411f-8813-b41ef2465fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.449451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca963b-7693-411f-8813-b41ef2465fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.569196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-10ca963b-7693-411f-8813-b41ef2465fb5 None None] MFA Rules not processed for user `2fddf039f65a4cff95c9c2041dd81ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:58.570716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-10ca963b-7693-411f-8813-b41ef2465fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.586756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e566a-f2f2-4411-a47c-c0c0357cbb30 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:58.590474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 841/1654] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:39:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:58.591707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8da41b-835b-49c9-8c6a-e3565852c31d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.591992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8da41b-835b-49c9-8c6a-e3565852c31d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.596199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8da41b-835b-49c9-8c6a-e3565852c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.596358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:58.596871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.597803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.598084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.604740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.640751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5b8da41b-835b-49c9-8c6a-e3565852c31d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:58.642629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5b8da41b-835b-49c9-8c6a-e3565852c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.758314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:58.759772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:58.775499 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 814/1655] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:58.776724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:58.819907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 842/1656] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:58.827866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e6be1-9305-40e2-bd9f-8d3ed2db625c service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:58.837311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:58.838181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.838594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.839088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.849525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:58.851158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:58.856829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8da41b-835b-49c9-8c6a-e3565852c31d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:58.858805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5b8da41b-835b-49c9-8c6a-e3565852c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:58.863237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 815/1657] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:58.877145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8da41b-835b-49c9-8c6a-e3565852c31d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:58.888105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:58.889052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:58.889482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:58.889935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:58.918901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:58.924493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:58.948269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 843/1658] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:59.382289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:59.384742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:59.408202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:59.408202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:59.420301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ba875-c4da-42ed-ae20-697bebf448a2 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:59.431075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:59.435364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:59.438208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:59.439479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] PATH_INFO: `/v3/projects/c4c1d398e6214fec98dbd4baf7e7e560` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:59.442163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc5ef0-9839-4ed3-9e5e-a0de40bb1840 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:59.442418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c1d398e6214fec98dbd4baf7e7e560)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:59.444734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 17:39:59.444734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 16 17:39:59.444734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: May 16 17:39:59.447626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:59.456644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:59.457539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:59.457832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:59.458128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] PATH_INFO: `/v3/users/93f22220c9f144ef92b0cd0bf90c23df` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:59.464965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f22220c9f144ef92b0cd0bf90c23df)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:59.466816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:59.603858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f22220c9f144ef92b0cd0bf90c23df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.616267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c1d398e6214fec98dbd4baf7e7e560', 'request_id': 'req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.635795 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f22220c9f144ef92b0cd0bf90c23df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.636682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f22220c9f144ef92b0cd0bf90c23df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.647342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f22220c9f144ef92b0cd0bf90c23df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.653051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c1d398e6214fec98dbd4baf7e7e560', 'request_id': 'req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.667584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5d35106d-7bf5-447a-a7be-9b36a1cdd4eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f22220c9f144ef92b0cd0bf90c23df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.681481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 844/1659] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:39:59 2022] DELETE /identity/v3/users/93f22220c9f144ef92b0cd0bf90c23df => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:39:59.682301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c1d398e6214fec98dbd4baf7e7e560', 'request_id': 'req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.683314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12dac7-aee8-4da6-9f03-0e60b62ee9d0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:59.683606 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12dac7-aee8-4da6-9f03-0e60b62ee9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:59.683881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12dac7-aee8-4da6-9f03-0e60b62ee9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:59.709702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] The token cache is being invalidate because project c4c1d398e6214fec98dbd4baf7e7e560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:39:59.710208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.711728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47a6b3c7-05e9-41d6-ba93-5fd52ed5e9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:59.714227 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 816/1660] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:39:59 2022] DELETE /identity/v3/projects/c4c1d398e6214fec98dbd4baf7e7e560 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:59.718526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2b12dac7-aee8-4da6-9f03-0e60b62ee9d0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:59.718666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02724f99-577e-4ab4-b27b-0c57f87b777f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:59.718943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02724f99-577e-4ab4-b27b-0c57f87b777f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:59.719226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02724f99-577e-4ab4-b27b-0c57f87b777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:59.720267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2b12dac7-aee8-4da6-9f03-0e60b62ee9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:59.806203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 845/1661] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:59.807932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-02724f99-577e-4ab4-b27b-0c57f87b777f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:59.809438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-02724f99-577e-4ab4-b27b-0c57f87b777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:59.829925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12dac7-aee8-4da6-9f03-0e60b62ee9d0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:59.832895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2b12dac7-aee8-4da6-9f03-0e60b62ee9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:59.837424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 817/1662] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:39:59.846650 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3e79f-5bdf-409c-b65f-c2b79fe1917b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:59.846960 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3e79f-5bdf-409c-b65f-c2b79fe1917b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:59.847366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3e79f-5bdf-409c-b65f-c2b79fe1917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:59.914733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12dac7-aee8-4da6-9f03-0e60b62ee9d0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:59.919517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367e33-38fd-422e-b54a-b68deb3ce803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:59.920230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e33-38fd-422e-b54a-b68deb3ce803 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:59.920326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3af3e79f-5bdf-409c-b65f-c2b79fe1917b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:39:59.920511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e33-38fd-422e-b54a-b68deb3ce803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:59.920773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e33-38fd-422e-b54a-b68deb3ce803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:59.921777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3af3e79f-5bdf-409c-b65f-c2b79fe1917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:59.935775 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6367e33-38fd-422e-b54a-b68deb3ce803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:59.937381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6367e33-38fd-422e-b54a-b68deb3ce803 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:59.947390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 818/1663] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:39:59.948712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3e79f-5bdf-409c-b65f-c2b79fe1917b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:59.958607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 846/1664] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:39:59.962775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3e79f-5bdf-409c-b65f-c2b79fe1917b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:59.980670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99be9-1ab8-4a50-ab3c-5c28f22250fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:59.983916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99be9-1ab8-4a50-ab3c-5c28f22250fb admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:59.984364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99be9-1ab8-4a50-ab3c-5c28f22250fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:59.984768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99be9-1ab8-4a50-ab3c-5c28f22250fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:59.985757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f99be9-1ab8-4a50-ab3c-5c28f22250fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:39:59.987661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f99be9-1ab8-4a50-ab3c-5c28f22250fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:59.991188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f99be9-1ab8-4a50-ab3c-5c28f22250fb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.031247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 819/1665] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:00.033183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367e33-38fd-422e-b54a-b68deb3ce803 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:00.047214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367e33-38fd-422e-b54a-b68deb3ce803 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:00.057019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db43ce9-a02d-42a6-9428-e0c18e3b2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:00.057945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43ce9-a02d-42a6-9428-e0c18e3b2b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.058281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43ce9-a02d-42a6-9428-e0c18e3b2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.058554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43ce9-a02d-42a6-9428-e0c18e3b2b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.059306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db43ce9-a02d-42a6-9428-e0c18e3b2b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:00.061338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db43ce9-a02d-42a6-9428-e0c18e3b2b8d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.097846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9152-c940-4900-9a85-306d828950f9 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.098167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9152-c940-4900-9a85-306d828950f9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.098618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9152-c940-4900-9a85-306d828950f9 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.100311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 820/1666] 10.222.0.58 () {54 vars in 960 bytes} [Mon May 16 17:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 17:40:00.108104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f620-a4dc-4156-aabd-758e11225201 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.108675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f620-a4dc-4156-aabd-758e11225201 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.108911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f620-a4dc-4156-aabd-758e11225201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.115483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 847/1667] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:00 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:00.119199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db43ce9-a02d-42a6-9428-e0c18e3b2b8d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:00.139431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9d93f620-a4dc-4156-aabd-758e11225201 None None] MFA Rules not processed for user `02938c77178a4f14a33ff1298775687c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:00.141002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9d93f620-a4dc-4156-aabd-758e11225201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:00.245998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db43ce9-a02d-42a6-9428-e0c18e3b2b8d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:00.256473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:00.257343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.258100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.258640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.261232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:00.263349 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.304908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 821/1668] 10.222.0.58 () {58 vars in 1057 bytes} [Mon May 16 17:40:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:00.305828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f620-a4dc-4156-aabd-758e11225201 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:00.307154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9d93f620-a4dc-4156-aabd-758e11225201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:00.324897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 848/1669] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:00 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:00.324897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:00.328774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:00.332168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f620-a4dc-4156-aabd-758e11225201 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:00.339123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:00.340240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.340655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.341133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] PATH_INFO: `/v3/projects/d46b5de0228b41b8b7f1f7cbb3d10fb9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.343198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46b5de0228b41b8b7f1f7cbb3d10fb9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:00.345371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.350039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef1209-fe37-4caf-a8ce-f64917274748 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:00.359980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:00.390012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.390545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.391012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] PATH_INFO: `/v3/projects/2274077667c34bfe97aef60336abd908` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.393442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2274077667c34bfe97aef60336abd908)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:00.396716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.426636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46b5de0228b41b8b7f1f7cbb3d10fb9', 'request_id': 'req-6821be39-5cca-4a46-9f5e-cca674fd7a78'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.440885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46b5de0228b41b8b7f1f7cbb3d10fb9', 'request_id': 'req-6821be39-5cca-4a46-9f5e-cca674fd7a78'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.459157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46b5de0228b41b8b7f1f7cbb3d10fb9', 'request_id': 'req-6821be39-5cca-4a46-9f5e-cca674fd7a78'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.474048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] The token cache is being invalidate because project d46b5de0228b41b8b7f1f7cbb3d10fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:00.474693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.475553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.478162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 822/1670] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:00 2022] DELETE /identity/v3/projects/d46b5de0228b41b8b7f1f7cbb3d10fb9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:00.479655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:00.481543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:00.490691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2274077667c34bfe97aef60336abd908', 'request_id': 'req-77def0e6-1b65-49fc-8ffb-71de7049ceab'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.509536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2274077667c34bfe97aef60336abd908', 'request_id': 'req-77def0e6-1b65-49fc-8ffb-71de7049ceab'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.531058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2274077667c34bfe97aef60336abd908', 'request_id': 'req-77def0e6-1b65-49fc-8ffb-71de7049ceab'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.549295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] The token cache is being invalidate because project 2274077667c34bfe97aef60336abd908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:00.549295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.552562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.555457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 849/1671] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:00 2022] DELETE /identity/v3/projects/2274077667c34bfe97aef60336abd908 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:00.556289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:00.561695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:00.592695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821be39-5cca-4a46-9f5e-cca674fd7a78 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:00.733912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def0e6-1b65-49fc-8ffb-71de7049ceab admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:00.741438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02938c77178a4f14a33ff1298775687c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:00.742475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.742954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.743398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.745619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:00.745730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:00.746337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.746617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.746886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.747621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:00.749261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.762947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:00.764874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.770762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 850/1672] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:00.776811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:00.781790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:00.796538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 823/1673] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:00.800565 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:00.802949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:00.804692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90ecfa-aa93-4d3c-8eb5-a9132cc7bf26 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:00.819610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750c70b-3389-4114-8ef6-aa4a06b4cdb9 service placement] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:00.819773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:00.820677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.820959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.821249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] PATH_INFO: `/v3/users/d9be85e4309a44a1a43b24e27e92f372` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.822499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9be85e4309a44a1a43b24e27e92f372)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:00.829875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:00.830937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:00.831308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:00.831679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] PATH_INFO: `/v3/users/389c851de0f94f9d864f4302f2426279` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:00.832784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.835440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] RBAC: Authorizing `identity:delete_user(user_id=389c851de0f94f9d864f4302f2426279)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:00.843525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:00.957872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389c851de0f94f9d864f4302f2426279'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.973102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9be85e4309a44a1a43b24e27e92f372'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.977978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389c851de0f94f9d864f4302f2426279'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.978815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389c851de0f94f9d864f4302f2426279'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.987693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389c851de0f94f9d864f4302f2426279'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:00.998891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389c851de0f94f9d864f4302f2426279'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.004627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9be85e4309a44a1a43b24e27e92f372'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.010293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9be85e4309a44a1a43b24e27e92f372'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.023835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9be85e4309a44a1a43b24e27e92f372'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.031035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 824/1674] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:00 2022] DELETE /identity/v3/users/389c851de0f94f9d864f4302f2426279 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:01.032201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:01.033917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:01.049191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9be85e4309a44a1a43b24e27e92f372'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.060211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 851/1675] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:00 2022] DELETE /identity/v3/users/d9be85e4309a44a1a43b24e27e92f372 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:01.061280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:01.066638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:01.168944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7a29d-1cdb-4764-ab1e-ddb1f0dc396b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:01.193754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92c1f5-3d71-4b67-82ca-c0ac201e49fd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:01.200445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8330254-02bd-4a3c-9b4e-763b32566d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:01.204352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8330254-02bd-4a3c-9b4e-763b32566d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:01.204352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8330254-02bd-4a3c-9b4e-763b32566d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:01.204352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8330254-02bd-4a3c-9b4e-763b32566d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:01.204352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8330254-02bd-4a3c-9b4e-763b32566d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:01.205226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8330254-02bd-4a3c-9b4e-763b32566d92 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:01.252438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 852/1676] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:01.253527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8330254-02bd-4a3c-9b4e-763b32566d92 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:01.273277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:01.274298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:01.274582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:01.274855 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] PATH_INFO: `/v3/projects/856203f959084015950211c4e61f8cbf` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:01.277361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856203f959084015950211c4e61f8cbf)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:01.295022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:01.299939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8330254-02bd-4a3c-9b4e-763b32566d92 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:01.320495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a367b6-e611-45a5-8866-854606eef446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:01.321404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a367b6-e611-45a5-8866-854606eef446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:01.321711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a367b6-e611-45a5-8866-854606eef446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:01.321985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a367b6-e611-45a5-8866-854606eef446 admin admin] PATH_INFO: `/v3/projects/20ad123c93e544f6904809e803beff23/users/ab675b5f7a7849b9afb394b7b9321009/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:01.361714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a367b6-e611-45a5-8866-854606eef446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ad123c93e544f6904809e803beff23, user_id=ab675b5f7a7849b9afb394b7b9321009, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:01.369634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a367b6-e611-45a5-8866-854606eef446 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:01.403668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 853/1677] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:01 2022] PUT /identity/v3/projects/20ad123c93e544f6904809e803beff23/users/ab675b5f7a7849b9afb394b7b9321009/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:01.418415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa848b3-5b8a-4838-832a-a6c3ff61732f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:01.419790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa848b3-5b8a-4838-832a-a6c3ff61732f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:01.421823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa848b3-5b8a-4838-832a-a6c3ff61732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:01.430175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856203f959084015950211c4e61f8cbf', 'request_id': 'req-1448f8c9-f139-49d3-bf77-d81161d95cd3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.448830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856203f959084015950211c4e61f8cbf', 'request_id': 'req-1448f8c9-f139-49d3-bf77-d81161d95cd3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.467926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856203f959084015950211c4e61f8cbf', 'request_id': 'req-1448f8c9-f139-49d3-bf77-d81161d95cd3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.485295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] The token cache is being invalidate because project 856203f959084015950211c4e61f8cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:01.485697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.487716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1448f8c9-f139-49d3-bf77-d81161d95cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:01.494202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 825/1678] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:01 2022] DELETE /identity/v3/projects/856203f959084015950211c4e61f8cbf => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:01.496176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765b897-7ea5-44b3-adc9-9386302c4139 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:01.496465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765b897-7ea5-44b3-adc9-9386302c4139 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:01.496776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765b897-7ea5-44b3-adc9-9386302c4139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:01.512110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-dfa848b3-5b8a-4838-832a-a6c3ff61732f None None] MFA Rules not processed for user `ab675b5f7a7849b9afb394b7b9321009`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:01.516590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-dfa848b3-5b8a-4838-832a-a6c3ff61732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:01.541469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d765b897-7ea5-44b3-adc9-9386302c4139 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:01.545447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d765b897-7ea5-44b3-adc9-9386302c4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:01.701187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 826/1679] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:01.701370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 854/1680] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:01.703464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab022e-a11e-4047-a6ca-0f504225e5bc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:01.703755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab022e-a11e-4047-a6ca-0f504225e5bc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:01.704100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab022e-a11e-4047-a6ca-0f504225e5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:01.712306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa848b3-5b8a-4838-832a-a6c3ff61732f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:01.730594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-dfa848b3-5b8a-4838-832a-a6c3ff61732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:01.776734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6cab022e-a11e-4047-a6ca-0f504225e5bc None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:01.779026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6cab022e-a11e-4047-a6ca-0f504225e5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:01.782834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa848b3-5b8a-4838-832a-a6c3ff61732f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:01.797274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973793f-fe0b-4553-a648-47556696c531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:01.797990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973793f-fe0b-4553-a648-47556696c531 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:01.798265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973793f-fe0b-4553-a648-47556696c531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:01.800560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973793f-fe0b-4553-a648-47556696c531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:01.803255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973793f-fe0b-4553-a648-47556696c531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:01.807260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 827/1681] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:01.807405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973793f-fe0b-4553-a648-47556696c531 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:01.809294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab022e-a11e-4047-a6ca-0f504225e5bc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:01.830526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab022e-a11e-4047-a6ca-0f504225e5bc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:01.842817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:01.844930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:01.845210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:01.845479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:01.847169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:01.847473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:01.851002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:01.875322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 855/1682] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:01 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:01.879026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973793f-fe0b-4553-a648-47556696c531 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:01.890576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 828/1683] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:01.891750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:01.913969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f29564-27e3-43b5-b6db-32a87e350d77 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.021777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973793f-fe0b-4553-a648-47556696c531 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.031007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8eca-baed-40fb-8706-a8c4f2816a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.031834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8eca-baed-40fb-8706-a8c4f2816a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.038890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8eca-baed-40fb-8706-a8c4f2816a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.039250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8eca-baed-40fb-8706-a8c4f2816a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.042952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df8eca-baed-40fb-8706-a8c4f2816a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:02.046622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.046879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df8eca-baed-40fb-8706-a8c4f2816a01 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:02.047836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.048175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.048457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.049770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:02.052153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:02.112465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 856/1684] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:01 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:02.112465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:02.114588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:02.136463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 829/1685] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:01 2022] POST /identity/v3/projects => generated 355 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:02.150971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8eca-baed-40fb-8706-a8c4f2816a01 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:02.165435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d345-4a62-4e9a-b7ad-29b089e51b5a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.276237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.277584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.278118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.278585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] PATH_INFO: `/v3/projects/c1f07220112d431d8e00dea4ec2bd0e6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.280549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f07220112d431d8e00dea4ec2bd0e6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:02.282874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:02.298082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8eca-baed-40fb-8706-a8c4f2816a01 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.304364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab2ed9-1ff6-4826-80bd-aecbac202a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.305105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2ed9-1ff6-4826-80bd-aecbac202a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.305539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2ed9-1ff6-4826-80bd-aecbac202a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.305840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2ed9-1ff6-4826-80bd-aecbac202a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.306626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab2ed9-1ff6-4826-80bd-aecbac202a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:02.308404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab2ed9-1ff6-4826-80bd-aecbac202a27 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:02.325062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 830/1686] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:02.326346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab2ed9-1ff6-4826-80bd-aecbac202a27 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:02.339139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab2ed9-1ff6-4826-80bd-aecbac202a27 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.346963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.347658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.347941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.348259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.349148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:02.351954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:02.386546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 831/1687] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:02 2022] POST /identity/v3/users => generated 278 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:02.387919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:02.388181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f07220112d431d8e00dea4ec2bd0e6', 'request_id': 'req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.390243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:02.399404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f07220112d431d8e00dea4ec2bd0e6', 'request_id': 'req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.404811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd1dd1-3571-44c3-a967-cb16f73902bb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.417938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f07220112d431d8e00dea4ec2bd0e6', 'request_id': 'req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.441289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] The token cache is being invalidate because project c1f07220112d431d8e00dea4ec2bd0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:02.441704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.442688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.446469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 857/1688] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:02 2022] DELETE /identity/v3/projects/c1f07220112d431d8e00dea4ec2bd0e6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:02.447397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:02.453106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:02.530113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.531229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.531537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.532756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] PATH_INFO: `/v3/projects/1152b943ac90453e8962c234ce933583` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.537920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1152b943ac90453e8962c234ce933583)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:02.541466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:02.603645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7b2f-619f-4ea9-afd6-5bba64f219b4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.611321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89750ba5-cb68-40b4-bcf8-2e33682ced31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.622822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750ba5-cb68-40b4-bcf8-2e33682ced31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.623332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750ba5-cb68-40b4-bcf8-2e33682ced31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.624000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750ba5-cb68-40b4-bcf8-2e33682ced31 admin admin] PATH_INFO: `/v3/projects/efd2db3313fa4d54abc3a28172aec397/users/5d98d62f2b78437e901e97a0de9076f5/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.644603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1152b943ac90453e8962c234ce933583', 'request_id': 'req-9cb42061-6551-4cb3-9362-6019a16675f9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.657814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89750ba5-cb68-40b4-bcf8-2e33682ced31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd2db3313fa4d54abc3a28172aec397, user_id=5d98d62f2b78437e901e97a0de9076f5, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:02.658890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1152b943ac90453e8962c234ce933583', 'request_id': 'req-9cb42061-6551-4cb3-9362-6019a16675f9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.666020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89750ba5-cb68-40b4-bcf8-2e33682ced31 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:02.677467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1152b943ac90453e8962c234ce933583', 'request_id': 'req-9cb42061-6551-4cb3-9362-6019a16675f9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.694982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] The token cache is being invalidate because project 1152b943ac90453e8962c234ce933583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:02.695766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.697207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:02.700091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 832/1689] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:02 2022] DELETE /identity/v3/projects/1152b943ac90453e8962c234ce933583 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:02.701377 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:02.704655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:02.717982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 858/1690] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:02 2022] PUT /identity/v3/projects/efd2db3313fa4d54abc3a28172aec397/users/5d98d62f2b78437e901e97a0de9076f5/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:02.719613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ca42-a2c1-4e8f-b7f7-6e49a6711e3a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.723239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ca42-a2c1-4e8f-b7f7-6e49a6711e3a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.723524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ca42-a2c1-4e8f-b7f7-6e49a6711e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.782389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4275ca42-a2c1-4e8f-b7f7-6e49a6711e3a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:02.784790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4275ca42-a2c1-4e8f-b7f7-6e49a6711e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:02.811177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42061-6551-4cb3-9362-6019a16675f9 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.898322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90f059-3814-42c1-9880-1e4831c01b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.899938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90f059-3814-42c1-9880-1e4831c01b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.900423 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90f059-3814-42c1-9880-1e4831c01b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.900887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90f059-3814-42c1-9880-1e4831c01b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.902016 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90f059-3814-42c1-9880-1e4831c01b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:02.904888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90f059-3814-42c1-9880-1e4831c01b08 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:02.925217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 833/1691] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:02.929542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d285b-1231-43f2-b1a6-2e4a89954fdb None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.930190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d285b-1231-43f2-b1a6-2e4a89954fdb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.930886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d285b-1231-43f2-b1a6-2e4a89954fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.939283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 859/1692] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:02.940304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ca42-a2c1-4e8f-b7f7-6e49a6711e3a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:02.949189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4275ca42-a2c1-4e8f-b7f7-6e49a6711e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:02.969298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275ca42-a2c1-4e8f-b7f7-6e49a6711e3a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:02.980267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-674d285b-1231-43f2-b1a6-2e4a89954fdb None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:02.981863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-674d285b-1231-43f2-b1a6-2e4a89954fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:02.986246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7388c8b-630e-4fde-a660-38ccc6f53b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:02.987042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7388c8b-630e-4fde-a660-38ccc6f53b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:02.987319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7388c8b-630e-4fde-a660-38ccc6f53b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:02.994782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 834/1693] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:02.995954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d285b-1231-43f2-b1a6-2e4a89954fdb None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:02.998433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7388c8b-630e-4fde-a660-38ccc6f53b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:02.998677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7388c8b-630e-4fde-a660-38ccc6f53b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.000310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7388c8b-630e-4fde-a660-38ccc6f53b48 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:03.013920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d285b-1231-43f2-b1a6-2e4a89954fdb None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:03.020956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1154f0-a0db-4c55-9992-0ab811497f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:03.022118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1154f0-a0db-4c55-9992-0ab811497f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.022553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1154f0-a0db-4c55-9992-0ab811497f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.023087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1154f0-a0db-4c55-9992-0ab811497f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.023990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1154f0-a0db-4c55-9992-0ab811497f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.026340 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1154f0-a0db-4c55-9992-0ab811497f28 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:03.033783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 860/1694] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:03.035109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbaaa4-a3bf-4355-b002-b18be861b7d9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.035399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbaaa4-a3bf-4355-b002-b18be861b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.035674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbaaa4-a3bf-4355-b002-b18be861b7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.068628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 835/1695] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:03.070911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622084-6a73-49ef-b3bd-c179e9e98344 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.071342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622084-6a73-49ef-b3bd-c179e9e98344 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.071761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622084-6a73-49ef-b3bd-c179e9e98344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.099420 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ddbaaa4-a3bf-4355-b002-b18be861b7d9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:03.101006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ddbaaa4-a3bf-4355-b002-b18be861b7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:03.108207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d4622084-6a73-49ef-b3bd-c179e9e98344 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:03.109561 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d4622084-6a73-49ef-b3bd-c179e9e98344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:03.128038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 836/1696] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:03.128895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622084-6a73-49ef-b3bd-c179e9e98344 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:03.132819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 861/1697] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:03.132819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbaaa4-a3bf-4355-b002-b18be861b7d9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:03.191951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622084-6a73-49ef-b3bd-c179e9e98344 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:03.195290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbaaa4-a3bf-4355-b002-b18be861b7d9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:03.210461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1abd66-7687-4f7a-8c31-b336961a5d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:03.222291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1abd66-7687-4f7a-8c31-b336961a5d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.222601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1abd66-7687-4f7a-8c31-b336961a5d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.222929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1abd66-7687-4f7a-8c31-b336961a5d7a admin admin] PATH_INFO: `/v3/projects/efd2db3313fa4d54abc3a28172aec397/users/5d98d62f2b78437e901e97a0de9076f5/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.224935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f221610-23aa-456f-83c9-b5f83f349f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:03.225899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f221610-23aa-456f-83c9-b5f83f349f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.226176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f221610-23aa-456f-83c9-b5f83f349f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.226443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f221610-23aa-456f-83c9-b5f83f349f8f admin admin] PATH_INFO: `/v3/projects/f9b5977c33a84dcf9a4df5e1d853786f/users/82f5da74791b457a97603bbd0da9152d/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.233112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1abd66-7687-4f7a-8c31-b336961a5d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd2db3313fa4d54abc3a28172aec397, user_id=5d98d62f2b78437e901e97a0de9076f5, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.245502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1abd66-7687-4f7a-8c31-b336961a5d7a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:03.290845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 837/1698] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:03 2022] PUT /identity/v3/projects/efd2db3313fa4d54abc3a28172aec397/users/5d98d62f2b78437e901e97a0de9076f5/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:03.291666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1abd66-7687-4f7a-8c31-b336961a5d7a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:03.297433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f221610-23aa-456f-83c9-b5f83f349f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b5977c33a84dcf9a4df5e1d853786f, user_id=82f5da74791b457a97603bbd0da9152d, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.310177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f221610-23aa-456f-83c9-b5f83f349f8f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:03.376484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 862/1699] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:03 2022] PUT /identity/v3/projects/f9b5977c33a84dcf9a4df5e1d853786f/users/82f5da74791b457a97603bbd0da9152d/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:03.376484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f221610-23aa-456f-83c9-b5f83f349f8f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:03.425481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1abd66-7687-4f7a-8c31-b336961a5d7a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:03.512841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f221610-23aa-456f-83c9-b5f83f349f8f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:03.518695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d46ac-d614-45d3-974e-3a561d8895f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:03.519539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d46ac-d614-45d3-974e-3a561d8895f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.519847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d46ac-d614-45d3-974e-3a561d8895f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.520124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d46ac-d614-45d3-974e-3a561d8895f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.521191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d46ac-d614-45d3-974e-3a561d8895f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:03.521569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d46ac-d614-45d3-974e-3a561d8895f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.524806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d46ac-d614-45d3-974e-3a561d8895f4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:03.535659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081acdf0-c373-49bd-9ba5-45d60d2c5473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:03.538132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acdf0-c373-49bd-9ba5-45d60d2c5473 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.542630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acdf0-c373-49bd-9ba5-45d60d2c5473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.543137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acdf0-c373-49bd-9ba5-45d60d2c5473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.546996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081acdf0-c373-49bd-9ba5-45d60d2c5473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:03.548860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081acdf0-c373-49bd-9ba5-45d60d2c5473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.551315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081acdf0-c373-49bd-9ba5-45d60d2c5473 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:03.565600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 863/1700] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:03.568494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a5416-f041-426f-9bc8-0d4226915346 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.571505 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a5416-f041-426f-9bc8-0d4226915346 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.571817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a5416-f041-426f-9bc8-0d4226915346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.588169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 838/1701] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:03.588169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b34fd-2642-4603-8389-6273671e787e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.588169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b34fd-2642-4603-8389-6273671e787e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.588169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b34fd-2642-4603-8389-6273671e787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.628659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-553b34fd-2642-4603-8389-6273671e787e None None] MFA Rules not processed for user `82f5da74791b457a97603bbd0da9152d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:03.630691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-553b34fd-2642-4603-8389-6273671e787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:03.647427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e98a5416-f041-426f-9bc8-0d4226915346 None None] MFA Rules not processed for user `5d98d62f2b78437e901e97a0de9076f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:03.651905 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e98a5416-f041-426f-9bc8-0d4226915346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:03.735282 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 839/1702] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:03 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:03.736339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b34fd-2642-4603-8389-6273671e787e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:03.758906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b34fd-2642-4603-8389-6273671e787e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:03.771562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122de079-289e-4ab1-9b07-0c22e52f622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:03.772611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122de079-289e-4ab1-9b07-0c22e52f622d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.773034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122de079-289e-4ab1-9b07-0c22e52f622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.773385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122de079-289e-4ab1-9b07-0c22e52f622d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.774847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122de079-289e-4ab1-9b07-0c22e52f622d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.777287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122de079-289e-4ab1-9b07-0c22e52f622d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:03.844233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 840/1703] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:03 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:03.845268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122de079-289e-4ab1-9b07-0c22e52f622d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:03.853866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 864/1704] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:03.854821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a5416-f041-426f-9bc8-0d4226915346 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:03.871153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a5416-f041-426f-9bc8-0d4226915346 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:03.964214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122de079-289e-4ab1-9b07-0c22e52f622d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:03.970632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afc68-a954-454d-846d-9eb211e1663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:03.971342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afc68-a954-454d-846d-9eb211e1663a admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.971584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afc68-a954-454d-846d-9eb211e1663a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.971857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afc68-a954-454d-846d-9eb211e1663a admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.972559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afc68-a954-454d-846d-9eb211e1663a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.972684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:03.974186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:03.974607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:03.975442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afc68-a954-454d-846d-9eb211e1663a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:03.975791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:03.976633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:03.980664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.015456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 841/1705] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:03 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:04.016838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afc68-a954-454d-846d-9eb211e1663a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.048744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 865/1706] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:03 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:04.048744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.052869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:04.163103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afc68-a954-454d-846d-9eb211e1663a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.231858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74218fb3-c792-4059-b2e3-4c94d4fc99df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.232714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74218fb3-c792-4059-b2e3-4c94d4fc99df admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.233000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74218fb3-c792-4059-b2e3-4c94d4fc99df admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.233275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74218fb3-c792-4059-b2e3-4c94d4fc99df admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.234018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74218fb3-c792-4059-b2e3-4c94d4fc99df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.236076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74218fb3-c792-4059-b2e3-4c94d4fc99df admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.249657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658408f-87ee-4e1c-9361-0eb7ccdac193 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.254584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d80cf1-1ee9-4b60-9de6-401016376114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.256224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80cf1-1ee9-4b60-9de6-401016376114 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.256650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80cf1-1ee9-4b60-9de6-401016376114 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.257342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80cf1-1ee9-4b60-9de6-401016376114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.274624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 842/1707] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:04 2022] POST /identity/v3/users => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:04.279347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74218fb3-c792-4059-b2e3-4c94d4fc99df admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.321225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74218fb3-c792-4059-b2e3-4c94d4fc99df admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.330047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cb509-3556-4a0b-aa0d-4472efa68b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.330738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb509-3556-4a0b-aa0d-4472efa68b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.331021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb509-3556-4a0b-aa0d-4472efa68b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.331443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb509-3556-4a0b-aa0d-4472efa68b72 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.332150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cb509-3556-4a0b-aa0d-4472efa68b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.334518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cb509-3556-4a0b-aa0d-4472efa68b72 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.367161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d80cf1-1ee9-4b60-9de6-401016376114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.369705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d80cf1-1ee9-4b60-9de6-401016376114 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.374031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 843/1708] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:04 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:04.375436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cb509-3556-4a0b-aa0d-4472efa68b72 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.388325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cb509-3556-4a0b-aa0d-4472efa68b72 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.393975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 866/1709] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:04.396304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fca387-37ac-4702-b857-3361b87c3fe5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.396590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fca387-37ac-4702-b857-3361b87c3fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.396867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fca387-37ac-4702-b857-3361b87c3fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.398605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e8890-c6eb-4378-ad82-d808035c84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.400836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e8890-c6eb-4378-ad82-d808035c84d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.401067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e8890-c6eb-4378-ad82-d808035c84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.401349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e8890-c6eb-4378-ad82-d808035c84d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.402093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e8890-c6eb-4378-ad82-d808035c84d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.404053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e8890-c6eb-4378-ad82-d808035c84d0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.456162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-95fca387-37ac-4702-b857-3361b87c3fe5 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:04.457427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-95fca387-37ac-4702-b857-3361b87c3fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:04.472479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 844/1710] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:04 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:04.473193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e8890-c6eb-4378-ad82-d808035c84d0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.503196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e8890-c6eb-4378-ad82-d808035c84d0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.537361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdcb05-667c-42e2-8849-2939b14bc5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.538067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdcb05-667c-42e2-8849-2939b14bc5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.538345 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdcb05-667c-42e2-8849-2939b14bc5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.538694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdcb05-667c-42e2-8849-2939b14bc5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.539351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdcb05-667c-42e2-8849-2939b14bc5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.540948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdcb05-667c-42e2-8849-2939b14bc5e8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.601975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 845/1711] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:04.604242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdcb05-667c-42e2-8849-2939b14bc5e8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.615458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 867/1712] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:40:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:04.616883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fca387-37ac-4702-b857-3361b87c3fe5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.638541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdcb05-667c-42e2-8849-2939b14bc5e8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.652964 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fca387-37ac-4702-b857-3361b87c3fe5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.654129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2b87-ba0d-4f7b-9028-39c74448e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.656131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2b87-ba0d-4f7b-9028-39c74448e4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.658479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2b87-ba0d-4f7b-9028-39c74448e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.658858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2b87-ba0d-4f7b-9028-39c74448e4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.659945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c6c12-7c0b-493d-bde6-8b6056be8487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.660593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c6c12-7c0b-493d-bde6-8b6056be8487 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.660928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c6c12-7c0b-493d-bde6-8b6056be8487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.661306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c6c12-7c0b-493d-bde6-8b6056be8487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.661410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2b87-ba0d-4f7b-9028-39c74448e4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.662893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c6c12-7c0b-493d-bde6-8b6056be8487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.664906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2b87-ba0d-4f7b-9028-39c74448e4aa admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.665081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c6c12-7c0b-493d-bde6-8b6056be8487 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.683508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 868/1713] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:04.685170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c6c12-7c0b-493d-bde6-8b6056be8487 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.699035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 846/1714] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:04.700277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2b87-ba0d-4f7b-9028-39c74448e4aa admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.704778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c6c12-7c0b-493d-bde6-8b6056be8487 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.710461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.713005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.713446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.713832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.721836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2b87-ba0d-4f7b-9028-39c74448e4aa admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.723063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:04.735878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f524f39-af2e-41be-8316-fc7fa8c6c81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.736658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524f39-af2e-41be-8316-fc7fa8c6c81f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.737163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524f39-af2e-41be-8316-fc7fa8c6c81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.737399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524f39-af2e-41be-8316-fc7fa8c6c81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.738319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f524f39-af2e-41be-8316-fc7fa8c6c81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.740055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f524f39-af2e-41be-8316-fc7fa8c6c81f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.766171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 847/1715] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:04.772591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f524f39-af2e-41be-8316-fc7fa8c6c81f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.793187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f524f39-af2e-41be-8316-fc7fa8c6c81f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:04.816813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3187b55-bda9-404d-8ca9-e2e3e01b45ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:04.821503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3187b55-bda9-404d-8ca9-e2e3e01b45ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:04.821503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3187b55-bda9-404d-8ca9-e2e3e01b45ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:04.822029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3187b55-bda9-404d-8ca9-e2e3e01b45ea admin admin] PATH_INFO: `/v3/projects/bcc626a2b93d4d2297dd21b12fec7d94/users/d325fcf04b6747239f2bdd53082179c2/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:04.862582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3187b55-bda9-404d-8ca9-e2e3e01b45ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc626a2b93d4d2297dd21b12fec7d94, user_id=d325fcf04b6747239f2bdd53082179c2, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.869916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3187b55-bda9-404d-8ca9-e2e3e01b45ea admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.890527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:04.891650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:04.901864 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 848/1716] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:04 2022] PUT /identity/v3/projects/bcc626a2b93d4d2297dd21b12fec7d94/users/d325fcf04b6747239f2bdd53082179c2/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:04.906043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3187b55-bda9-404d-8ca9-e2e3e01b45ea admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.938606 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 869/1717] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:04.939565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:04.972448 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfd23-3281-444c-9d4b-7f3a16c1de9e service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:05.072145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3187b55-bda9-404d-8ca9-e2e3e01b45ea admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:05.083211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:05.083960 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:05.084234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:05.084514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:05.085257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:05.086922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:05.129775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 849/1718] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:05.132229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:05.135238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366058a-3d5e-41b3-b81e-309d329fc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:05.137399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366058a-3d5e-41b3-b81e-309d329fc1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:05.137759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366058a-3d5e-41b3-b81e-309d329fc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:05.138032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366058a-3d5e-41b3-b81e-309d329fc1b4 admin admin] PATH_INFO: `/v3/projects/5ddb9edb04784fcea450ed7451658731/users/3e692de595134641a293a6a11276b6a5/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:05.152056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:05.175619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366058a-3d5e-41b3-b81e-309d329fc1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddb9edb04784fcea450ed7451658731, user_id=3e692de595134641a293a6a11276b6a5, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:05.178468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366058a-3d5e-41b3-b81e-309d329fc1b4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:05.222620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 870/1719] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:04 2022] PUT /identity/v3/projects/5ddb9edb04784fcea450ed7451658731/users/3e692de595134641a293a6a11276b6a5/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:05.223771 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366058a-3d5e-41b3-b81e-309d329fc1b4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:05.402074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366058a-3d5e-41b3-b81e-309d329fc1b4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:05.410991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691e713-20a0-4c70-b77a-38fa05f2e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:05.412593 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691e713-20a0-4c70-b77a-38fa05f2e592 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:05.412793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691e713-20a0-4c70-b77a-38fa05f2e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:05.413078 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691e713-20a0-4c70-b77a-38fa05f2e592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:05.415422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691e713-20a0-4c70-b77a-38fa05f2e592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:05.416144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36d1b4-25c7-47b4-806e-f7c5cea4208f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:05.419170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691e713-20a0-4c70-b77a-38fa05f2e592 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:05.456672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 871/1720] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:05.458607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691e713-20a0-4c70-b77a-38fa05f2e592 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:05.503242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625cbe4-4274-4f3d-8a39-34b6a6d80879 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:05.503983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cbe4-4274-4f3d-8a39-34b6a6d80879 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:05.504303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cbe4-4274-4f3d-8a39-34b6a6d80879 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:05.504885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cbe4-4274-4f3d-8a39-34b6a6d80879 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:05.508536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691e713-20a0-4c70-b77a-38fa05f2e592 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:05.514563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3df28-a7bf-4bd3-8adf-a6a265770f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:05.516982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3df28-a7bf-4bd3-8adf-a6a265770f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:05.521292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3df28-a7bf-4bd3-8adf-a6a265770f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:05.537132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3df28-a7bf-4bd3-8adf-a6a265770f74 admin admin] PATH_INFO: `/v3/projects/76214bd85deb41ce9993ce9570fc7f13/users/b053c4541a9444ceae2430a6207e35ec/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:05.571886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625cbe4-4274-4f3d-8a39-34b6a6d80879 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:05.573655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625cbe4-4274-4f3d-8a39-34b6a6d80879 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:05.598261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3df28-a7bf-4bd3-8adf-a6a265770f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76214bd85deb41ce9993ce9570fc7f13, user_id=b053c4541a9444ceae2430a6207e35ec, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:05.602663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3df28-a7bf-4bd3-8adf-a6a265770f74 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:05.604287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 850/1721] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:40:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:40:05.606341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd64ed-c51c-49cb-ac3f-52b7e3e78199 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:05.606659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd64ed-c51c-49cb-ac3f-52b7e3e78199 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:05.607011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd64ed-c51c-49cb-ac3f-52b7e3e78199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:05.646052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 872/1722] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:05 2022] PUT /identity/v3/projects/76214bd85deb41ce9993ce9570fc7f13/users/b053c4541a9444ceae2430a6207e35ec/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:05.648072 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3df28-a7bf-4bd3-8adf-a6a265770f74 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:05.821112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2dfd64ed-c51c-49cb-ac3f-52b7e3e78199 None None] MFA Rules not processed for user `3e692de595134641a293a6a11276b6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:05.822594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2dfd64ed-c51c-49cb-ac3f-52b7e3e78199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:05.846868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3df28-a7bf-4bd3-8adf-a6a265770f74 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:05.882331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2ebcf-4c54-4882-9ad7-d396214a27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:05.883647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ebcf-4c54-4882-9ad7-d396214a27cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:05.894907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ebcf-4c54-4882-9ad7-d396214a27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:05.900639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ebcf-4c54-4882-9ad7-d396214a27cf admin admin] PATH_INFO: `/v3/projects/bcc626a2b93d4d2297dd21b12fec7d94/users/d325fcf04b6747239f2bdd53082179c2/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:05.911634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2ebcf-4c54-4882-9ad7-d396214a27cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc626a2b93d4d2297dd21b12fec7d94, user_id=d325fcf04b6747239f2bdd53082179c2, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:05.926352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2ebcf-4c54-4882-9ad7-d396214a27cf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:06.011932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 873/1723] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:05 2022] PUT /identity/v3/projects/bcc626a2b93d4d2297dd21b12fec7d94/users/d325fcf04b6747239f2bdd53082179c2/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:06.017703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dee2b-075f-41d6-a28b-4d8db8daec7e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:06.018257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dee2b-075f-41d6-a28b-4d8db8daec7e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:06.018765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dee2b-075f-41d6-a28b-4d8db8daec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:06.151370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c72dee2b-075f-41d6-a28b-4d8db8daec7e None None] MFA Rules not processed for user `b053c4541a9444ceae2430a6207e35ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:06.164189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c72dee2b-075f-41d6-a28b-4d8db8daec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:06.486806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 874/1724] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:06.503778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91097ab-aa85-4952-ad26-2171f20c25fd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:06.504070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91097ab-aa85-4952-ad26-2171f20c25fd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:06.504357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91097ab-aa85-4952-ad26-2171f20c25fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:06.540088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 851/1725] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 935 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:06.542765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd64ed-c51c-49cb-ac3f-52b7e3e78199 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:06.549481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2dfd64ed-c51c-49cb-ac3f-52b7e3e78199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:06.573518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd64ed-c51c-49cb-ac3f-52b7e3e78199 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:06.588245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c91097ab-aa85-4952-ad26-2171f20c25fd None None] MFA Rules not processed for user `d325fcf04b6747239f2bdd53082179c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:06.589405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c91097ab-aa85-4952-ad26-2171f20c25fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:06.692996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:06.694221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:06.694567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:06.694875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] PATH_INFO: `/v3/users/2b97874877694c3ea7cbc1af2a848b2a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:06.697912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b97874877694c3ea7cbc1af2a848b2a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:06.700211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:06.809003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b97874877694c3ea7cbc1af2a848b2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:06.843268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 875/1726] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:06 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:06.846630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bdb61-484e-44f4-8f64-92505b685c99 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:06.849734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bdb61-484e-44f4-8f64-92505b685c99 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:06.853859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bdb61-484e-44f4-8f64-92505b685c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:06.886594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b97874877694c3ea7cbc1af2a848b2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:06.888396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b97874877694c3ea7cbc1af2a848b2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:06.889216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b97874877694c3ea7cbc1af2a848b2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:06.901372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b97874877694c3ea7cbc1af2a848b2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:06.922363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 852/1727] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:06 2022] DELETE /identity/v3/users/2b97874877694c3ea7cbc1af2a848b2a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:06.923489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:06.925000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:06.938977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7b3bdb61-484e-44f4-8f64-92505b685c99 None None] MFA Rules not processed for user `2fddf039f65a4cff95c9c2041dd81ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:06.943875 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7b3bdb61-484e-44f4-8f64-92505b685c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:07.030416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1d2a7-3249-4d31-b105-46c565620f8b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:07.053809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:07.060099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:07.062563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:07.063618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:07.068407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:07.073191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:07.123197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 876/1728] 10.222.0.35 () {58 vars in 1015 bytes} [Mon May 16 17:40:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:07.129648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bdb61-484e-44f4-8f64-92505b685c99 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:07.133335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 853/1729] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:06 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:07.134064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:07.138038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:07.142172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7b3bdb61-484e-44f4-8f64-92505b685c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:07.182444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bdb61-484e-44f4-8f64-92505b685c99 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:07.283039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee2a9-c1bf-4ed1-936f-fafecdbe7231 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:07.299056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af906fdb-521e-402e-8040-fe98993bbd7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:07.299856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af906fdb-521e-402e-8040-fe98993bbd7e service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:07.299993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af906fdb-521e-402e-8040-fe98993bbd7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:07.300261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af906fdb-521e-402e-8040-fe98993bbd7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:07.304748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-af906fdb-521e-402e-8040-fe98993bbd7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:07.426882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e276ced-edd0-4a9e-9336-629db2e54f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:07.427774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e276ced-edd0-4a9e-9336-629db2e54f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:07.427886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e276ced-edd0-4a9e-9336-629db2e54f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:07.428152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e276ced-edd0-4a9e-9336-629db2e54f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:07.428858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e276ced-edd0-4a9e-9336-629db2e54f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:07.442260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e276ced-edd0-4a9e-9336-629db2e54f3a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:07.505573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 877/1730] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:07 2022] POST /identity/v3/projects => generated 401 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:07.506854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64eb89-9861-491c-a499-d43c55f61706 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:07.507095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64eb89-9861-491c-a499-d43c55f61706 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:07.507316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64eb89-9861-491c-a499-d43c55f61706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:07.531405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af906fdb-521e-402e-8040-fe98993bbd7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:07.534865 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af906fdb-521e-402e-8040-fe98993bbd7e service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:07.562407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9b64eb89-9861-491c-a499-d43c55f61706 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:07.568114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9b64eb89-9861-491c-a499-d43c55f61706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:07.575181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 854/1731] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:07 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:07.595218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b603eb-a710-44d9-8c44-cf138d8bfa67 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:07.595823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b603eb-a710-44d9-8c44-cf138d8bfa67 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:07.596069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b603eb-a710-44d9-8c44-cf138d8bfa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:07.717409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f3b603eb-a710-44d9-8c44-cf138d8bfa67 None None] MFA Rules not processed for user `c482d82afb734e10a5a11070fcb5f736`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:07.719786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f3b603eb-a710-44d9-8c44-cf138d8bfa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:07.798723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 878/1732] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:07.799972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64eb89-9861-491c-a499-d43c55f61706 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:07.820124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64eb89-9861-491c-a499-d43c55f61706 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:07.834412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:07.835343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:07.835772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:07.836195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:07.839291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:07.841434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:07.877540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 879/1733] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:07 2022] POST /identity/v3/users => generated 289 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:07.878158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:07.889929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:07.898815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 855/1734] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:07.900221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b603eb-a710-44d9-8c44-cf138d8bfa67 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:07.951416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b603eb-a710-44d9-8c44-cf138d8bfa67 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:07.961685 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e3c5-1ab1-4447-a308-409e6cb7883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:07.965312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e3c5-1ab1-4447-a308-409e6cb7883f admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:07.967237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e3c5-1ab1-4447-a308-409e6cb7883f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:07.967742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e3c5-1ab1-4447-a308-409e6cb7883f admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:07.969411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e3c5-1ab1-4447-a308-409e6cb7883f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:07.979644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e3c5-1ab1-4447-a308-409e6cb7883f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:08.009255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144ca38-158a-4453-8d03-33c3ba1972c4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:08.014865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6af34-2518-437b-89d9-1aba6f8df82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:08.016077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6af34-2518-437b-89d9-1aba6f8df82d service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.017083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6af34-2518-437b-89d9-1aba6f8df82d service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.017372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6af34-2518-437b-89d9-1aba6f8df82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.022437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 856/1735] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:07 2022] POST /identity/v3/users => generated 307 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:08.023549 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e3c5-1ab1-4447-a308-409e6cb7883f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:08.039963 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6af34-2518-437b-89d9-1aba6f8df82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:08.041744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6af34-2518-437b-89d9-1aba6f8df82d service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:08.088037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 880/1736] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:08.089376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6af34-2518-437b-89d9-1aba6f8df82d service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:08.127995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6af34-2518-437b-89d9-1aba6f8df82d service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:08.140403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4a6a1-dc94-4cd8-a1a1-8e0c40d59589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:08.141066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4a6a1-dc94-4cd8-a1a1-8e0c40d59589 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.141924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4a6a1-dc94-4cd8-a1a1-8e0c40d59589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.142261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4a6a1-dc94-4cd8-a1a1-8e0c40d59589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.164832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e3c5-1ab1-4447-a308-409e6cb7883f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:08.174857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4a6a1-dc94-4cd8-a1a1-8e0c40d59589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:08.176273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:08.176407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4a6a1-dc94-4cd8-a1a1-8e0c40d59589 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:08.176970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.177291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.177581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.183634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:08.216445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 881/1737] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:08.217314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4a6a1-dc94-4cd8-a1a1-8e0c40d59589 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:08.240326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4a6a1-dc94-4cd8-a1a1-8e0c40d59589 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:08.256718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84c72-fdcc-4754-ba68-f46ecb0110e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:08.257473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84c72-fdcc-4754-ba68-f46ecb0110e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.257758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84c72-fdcc-4754-ba68-f46ecb0110e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.258031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84c72-fdcc-4754-ba68-f46ecb0110e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.258799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84c72-fdcc-4754-ba68-f46ecb0110e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:08.272172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84c72-fdcc-4754-ba68-f46ecb0110e0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:08.294317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 882/1738] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:08.299094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b6be8-af22-422c-a22f-b9fc5bb7f3ab None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.299379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b6be8-af22-422c-a22f-b9fc5bb7f3ab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.299654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b6be8-af22-422c-a22f-b9fc5bb7f3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.343316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-373b6be8-af22-422c-a22f-b9fc5bb7f3ab None None] MFA Rules not processed for user `c482d82afb734e10a5a11070fcb5f736`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:08.344581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-373b6be8-af22-422c-a22f-b9fc5bb7f3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:08.373836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:08.379104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 883/1739] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:08.379104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b6be8-af22-422c-a22f-b9fc5bb7f3ab None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:08.379413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:08.403908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 857/1740] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:08 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:08.408666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:08.414913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b6be8-af22-422c-a22f-b9fc5bb7f3ab None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:08.429573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08367c6-f398-45be-8d6c-fd7ac1b24327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:08.430311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08367c6-f398-45be-8d6c-fd7ac1b24327 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.430609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08367c6-f398-45be-8d6c-fd7ac1b24327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.430880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08367c6-f398-45be-8d6c-fd7ac1b24327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.432210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08367c6-f398-45be-8d6c-fd7ac1b24327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:08.433344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08367c6-f398-45be-8d6c-fd7ac1b24327 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:08.443104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385d02b-0140-4660-913d-baccc727a8e9 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:08.454044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 884/1741] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:08.457468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ba10-5f61-433a-9a33-a18eb6d0c538 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.457792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ba10-5f61-433a-9a33-a18eb6d0c538 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.458071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ba10-5f61-433a-9a33-a18eb6d0c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.461063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:08.463819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.466398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.466398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] PATH_INFO: `/v3/projects/cae66812c4464acd918123403462cfc4/users/9dc0c9842f044a439357cc03936046da/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.515216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae66812c4464acd918123403462cfc4, user_id=9dc0c9842f044a439357cc03936046da, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:08.523999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:08.563019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 858/1742] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:08 2022] PUT /identity/v3/projects/cae66812c4464acd918123403462cfc4/users/9dc0c9842f044a439357cc03936046da/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:08.563019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:08.568358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:08.756263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d1c7d-d232-4978-a249-c425111b933a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:08.769866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca251d5-f1a2-4ad1-becb-27fad9a52aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:08.771101 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca251d5-f1a2-4ad1-becb-27fad9a52aca service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:08.772189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca251d5-f1a2-4ad1-becb-27fad9a52aca service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:08.773276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca251d5-f1a2-4ad1-becb-27fad9a52aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:08.917353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-13c5ba10-5f61-433a-9a33-a18eb6d0c538 None None] MFA Rules not processed for user `6838738598ce4d2186e7c0b6547868f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:08.919577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-13c5ba10-5f61-433a-9a33-a18eb6d0c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:09.004961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca251d5-f1a2-4ad1-becb-27fad9a52aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:09.012839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca251d5-f1a2-4ad1-becb-27fad9a52aca service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:09.058857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 859/1743] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:09.059883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca251d5-f1a2-4ad1-becb-27fad9a52aca service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:09.110086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 885/1744] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 655 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:09.110846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5ba10-5f61-433a-9a33-a18eb6d0c538 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:09.267832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca251d5-f1a2-4ad1-becb-27fad9a52aca service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:09.275742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:09.276656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:09.276932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:09.277201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] PATH_INFO: `/v3/projects/9a56524455c8452bbf98a7024e23391e/users/616574d1cc1a44d0a51bac7b9ef5acec/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:09.296975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a56524455c8452bbf98a7024e23391e, user_id=616574d1cc1a44d0a51bac7b9ef5acec, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:09.300406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:09.322982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 860/1745] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:09 2022] PUT /identity/v3/projects/9a56524455c8452bbf98a7024e23391e/users/616574d1cc1a44d0a51bac7b9ef5acec/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:09.326071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:09.334166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:09.397749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5ba10-5f61-433a-9a33-a18eb6d0c538 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:09.478999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d775b-d8a7-4b3e-8a59-9df909565318 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:09.494341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a9de4-b6ac-4a3c-ace5-39648f32dfd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:09.496320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a9de4-b6ac-4a3c-ace5-39648f32dfd5 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:09.496821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a9de4-b6ac-4a3c-ace5-39648f32dfd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:09.497305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a9de4-b6ac-4a3c-ace5-39648f32dfd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:09.534609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01498e75-316b-4826-97d2-d4030b581ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:09.535409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498e75-316b-4826-97d2-d4030b581ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:09.535695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498e75-316b-4826-97d2-d4030b581ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:09.535972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498e75-316b-4826-97d2-d4030b581ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:09.536989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01498e75-316b-4826-97d2-d4030b581ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:09.539285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01498e75-316b-4826-97d2-d4030b581ff0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:09.564347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 886/1746] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:09.565279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01498e75-316b-4826-97d2-d4030b581ff0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:09.592475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01498e75-316b-4826-97d2-d4030b581ff0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:09.602550 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56fea6-b38c-44e9-9109-5e379f890c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:09.603241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fea6-b38c-44e9-9109-5e379f890c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:09.603522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fea6-b38c-44e9-9109-5e379f890c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:09.603798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fea6-b38c-44e9-9109-5e379f890c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:09.604719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fea6-b38c-44e9-9109-5e379f890c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:09.606399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fea6-b38c-44e9-9109-5e379f890c61 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:09.632903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a9de4-b6ac-4a3c-ace5-39648f32dfd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:09.637467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 887/1747] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:09.638417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56fea6-b38c-44e9-9109-5e379f890c61 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:09.638651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a9de4-b6ac-4a3c-ace5-39648f32dfd5 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:09.663074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 861/1748] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:09.664313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a9de4-b6ac-4a3c-ace5-39648f32dfd5 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:09.672775 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56fea6-b38c-44e9-9109-5e379f890c61 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:09.689327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a9de4-b6ac-4a3c-ace5-39648f32dfd5 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:09.698050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f5657-2263-46ef-ad27-061d9ad7ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:09.699038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5657-2263-46ef-ad27-061d9ad7ce5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:09.699318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5657-2263-46ef-ad27-061d9ad7ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:09.699592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5657-2263-46ef-ad27-061d9ad7ce5f admin admin] PATH_INFO: `/v3/projects/cae66812c4464acd918123403462cfc4/users/9dc0c9842f044a439357cc03936046da/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:09.702240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc347f-64e3-4010-a025-8273f8c697af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:09.703416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc347f-64e3-4010-a025-8273f8c697af admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:09.705094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc347f-64e3-4010-a025-8273f8c697af admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:09.705603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc347f-64e3-4010-a025-8273f8c697af admin admin] PATH_INFO: `/v3/projects/9a56524455c8452bbf98a7024e23391e/users/616574d1cc1a44d0a51bac7b9ef5acec/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:09.710666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f5657-2263-46ef-ad27-061d9ad7ce5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae66812c4464acd918123403462cfc4, user_id=9dc0c9842f044a439357cc03936046da, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:09.713293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f5657-2263-46ef-ad27-061d9ad7ce5f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:09.715042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc347f-64e3-4010-a025-8273f8c697af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a56524455c8452bbf98a7024e23391e, user_id=616574d1cc1a44d0a51bac7b9ef5acec, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:09.718133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc347f-64e3-4010-a025-8273f8c697af admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:09.745929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 862/1749] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:09 2022] PUT /identity/v3/projects/9a56524455c8452bbf98a7024e23391e/users/616574d1cc1a44d0a51bac7b9ef5acec/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:09.759102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f234252-3ed4-4cb2-a197-50f4e6077fd7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:09.760179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f234252-3ed4-4cb2-a197-50f4e6077fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:09.760652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f234252-3ed4-4cb2-a197-50f4e6077fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:09.781881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 888/1750] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:09 2022] PUT /identity/v3/projects/cae66812c4464acd918123403462cfc4/users/9dc0c9842f044a439357cc03936046da/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:09.788552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aae256-2dec-49c1-b787-4d8db9b178b5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:09.788839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aae256-2dec-49c1-b787-4d8db9b178b5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:09.789229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aae256-2dec-49c1-b787-4d8db9b178b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:09.840946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2f234252-3ed4-4cb2-a197-50f4e6077fd7 None None] MFA Rules not processed for user `616574d1cc1a44d0a51bac7b9ef5acec`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:09.852413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2f234252-3ed4-4cb2-a197-50f4e6077fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:09.864471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-52aae256-2dec-49c1-b787-4d8db9b178b5 None None] MFA Rules not processed for user `9dc0c9842f044a439357cc03936046da`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:09.870223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-52aae256-2dec-49c1-b787-4d8db9b178b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:09.968276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 863/1751] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:09.981289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f234252-3ed4-4cb2-a197-50f4e6077fd7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:09.983660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2f234252-3ed4-4cb2-a197-50f4e6077fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:10.032122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 889/1752] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:10.124419 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aae256-2dec-49c1-b787-4d8db9b178b5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:10.144892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aae256-2dec-49c1-b787-4d8db9b178b5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:10.159267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e6ba1-cdd0-43cd-b0be-2237263b8ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:10.160821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f234252-3ed4-4cb2-a197-50f4e6077fd7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:10.165782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e6ba1-cdd0-43cd-b0be-2237263b8ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:10.167075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e6ba1-cdd0-43cd-b0be-2237263b8ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:10.167461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e6ba1-cdd0-43cd-b0be-2237263b8ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:10.182410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:10.183085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:10.183364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:10.183638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:10.221541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e6ba1-cdd0-43cd-b0be-2237263b8ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:10.227459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e6ba1-cdd0-43cd-b0be-2237263b8ff0 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:10.241039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:10.249068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:10.265391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 890/1753] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:10.276247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c961-f15a-464a-936d-8cc7cb505e72 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:10.276533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c961-f15a-464a-936d-8cc7cb505e72 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:10.276817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c961-f15a-464a-936d-8cc7cb505e72 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:10.280493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 891/1754] 10.222.0.58 () {54 vars in 912 bytes} [Mon May 16 17:40:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:40:10.286254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99298-8186-474b-a30c-806198b95f6d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:10.286610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99298-8186-474b-a30c-806198b95f6d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:10.288361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99298-8186-474b-a30c-806198b95f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:10.300195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 864/1755] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:10.319893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4de99298-8186-474b-a30c-806198b95f6d None None] MFA Rules not processed for user `2fddf039f65a4cff95c9c2041dd81ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:10.322353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4de99298-8186-474b-a30c-806198b95f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:10.438913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 892/1756] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:40:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:10.489013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:10.489013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:10.493859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede7081-3c36-4b77-b310-8369317ee6f4 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:10.505267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a4b1f-0e7e-463b-a0c8-0a35ee8c9064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:10.515415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4b1f-0e7e-463b-a0c8-0a35ee8c9064 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:10.517280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4b1f-0e7e-463b-a0c8-0a35ee8c9064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:10.518784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4b1f-0e7e-463b-a0c8-0a35ee8c9064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:10.527779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99298-8186-474b-a30c-806198b95f6d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:10.564825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99298-8186-474b-a30c-806198b95f6d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:10.580323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:10.582906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:10.583696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:10.583976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:10.587947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4b1f-0e7e-463b-a0c8-0a35ee8c9064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:10.590675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4b1f-0e7e-463b-a0c8-0a35ee8c9064 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:10.591995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:10.615738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 865/1757] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:10.620700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a4b1f-0e7e-463b-a0c8-0a35ee8c9064 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:10.646976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a4b1f-0e7e-463b-a0c8-0a35ee8c9064 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:10.655916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e211-ba24-41ec-a038-0edde35120bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:10.656735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e211-ba24-41ec-a038-0edde35120bd service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:10.659071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e211-ba24-41ec-a038-0edde35120bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:10.659475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e211-ba24-41ec-a038-0edde35120bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:10.666166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0c67e211-ba24-41ec-a038-0edde35120bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:10.712770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:10.715779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:10.729465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 893/1758] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:10.887054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67e211-ba24-41ec-a038-0edde35120bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:10.892649 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67e211-ba24-41ec-a038-0edde35120bd service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:10.932955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 866/1759] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:11.100428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:11.103745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:11.284586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48238f3-3729-4a89-84b4-014903d85692 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:11.307025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:11.308201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:11.308630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:11.309224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] PATH_INFO: `/v3/projects/94fe0f6c2e964969bd46781356d2539e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:11.311754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94fe0f6c2e964969bd46781356d2539e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:11.329409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:11.335099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9a9f-7bdd-41ad-a7c2-45e5ae00ea85 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:11.335531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9a9f-7bdd-41ad-a7c2-45e5ae00ea85 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:11.335905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9a9f-7bdd-41ad-a7c2-45e5ae00ea85 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:11.337743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 867/1760] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:40:11.342930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56bc79-8942-4128-ae7a-3f27be97a931 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:11.343338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56bc79-8942-4128-ae7a-3f27be97a931 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:11.343712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56bc79-8942-4128-ae7a-3f27be97a931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:11.396318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ba56bc79-8942-4128-ae7a-3f27be97a931 None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:11.403367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ba56bc79-8942-4128-ae7a-3f27be97a931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:11.464312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fe0f6c2e964969bd46781356d2539e', 'request_id': 'req-197c78e5-c519-4b8c-b669-c912408211d5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:11.501502 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fe0f6c2e964969bd46781356d2539e', 'request_id': 'req-197c78e5-c519-4b8c-b669-c912408211d5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:11.530496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fe0f6c2e964969bd46781356d2539e', 'request_id': 'req-197c78e5-c519-4b8c-b669-c912408211d5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:11.570296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] The token cache is being invalidate because project 94fe0f6c2e964969bd46781356d2539e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:11.571283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:11.575670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-197c78e5-c519-4b8c-b669-c912408211d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:11.583343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 894/1761] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:11 2022] DELETE /identity/v3/projects/94fe0f6c2e964969bd46781356d2539e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:11.591204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517e91-4e25-4dcb-84c0-979bdc824e1e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:11.591691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517e91-4e25-4dcb-84c0-979bdc824e1e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:11.592276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517e91-4e25-4dcb-84c0-979bdc824e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:11.629508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 868/1762] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:40:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:11.652332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56bc79-8942-4128-ae7a-3f27be97a931 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:11.653802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ba56bc79-8942-4128-ae7a-3f27be97a931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:11.676402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-20517e91-4e25-4dcb-84c0-979bdc824e1e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:11.678456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-20517e91-4e25-4dcb-84c0-979bdc824e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:11.691593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56bc79-8942-4128-ae7a-3f27be97a931 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:11.706046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b795e1-c6c1-4019-bf33-905bfe170fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:11.706760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b795e1-c6c1-4019-bf33-905bfe170fef service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:11.707035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b795e1-c6c1-4019-bf33-905bfe170fef service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:11.707354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b795e1-c6c1-4019-bf33-905bfe170fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:11.744593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b795e1-c6c1-4019-bf33-905bfe170fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:11.746773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b795e1-c6c1-4019-bf33-905bfe170fef service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:11.760743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 869/1763] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:11.935895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 895/1764] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:11.937409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7dce-4ec0-4ffc-b0ed-8d1756645138 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:11.937925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7dce-4ec0-4ffc-b0ed-8d1756645138 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:11.938226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7dce-4ec0-4ffc-b0ed-8d1756645138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:11.992669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-44cf7dce-4ec0-4ffc-b0ed-8d1756645138 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:12.004714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-44cf7dce-4ec0-4ffc-b0ed-8d1756645138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:12.047057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 870/1765] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:12.050404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517e91-4e25-4dcb-84c0-979bdc824e1e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:12.062464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517e91-4e25-4dcb-84c0-979bdc824e1e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:12.089966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:12.089966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:12.089966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:12.089966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:12.090285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:12.090285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:12.098691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:12.135712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 896/1766] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:12.140944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf7dce-4ec0-4ffc-b0ed-8d1756645138 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:12.152399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf7dce-4ec0-4ffc-b0ed-8d1756645138 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:12.170136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cba200-2cb5-449e-876a-98b16aaa91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:12.171659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba200-2cb5-449e-876a-98b16aaa91c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:12.172527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba200-2cb5-449e-876a-98b16aaa91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:12.172808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba200-2cb5-449e-876a-98b16aaa91c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:12.176452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cba200-2cb5-449e-876a-98b16aaa91c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:12.196280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cba200-2cb5-449e-876a-98b16aaa91c6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:12.307291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 871/1767] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:12 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:12.312189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:12.337166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bda6c-0737-48cd-b796-d39e60469426 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:12.575293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0b57-3da4-403a-8d04-a42631cd7544 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:12.576305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0b57-3da4-403a-8d04-a42631cd7544 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:12.576743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0b57-3da4-403a-8d04-a42631cd7544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:12.598645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-86ef0b57-3da4-403a-8d04-a42631cd7544 None None] MFA Rules not processed for user `c482d82afb734e10a5a11070fcb5f736`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:12.600403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-86ef0b57-3da4-403a-8d04-a42631cd7544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:12.668601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c311257-0d8a-4488-aa4b-823698a2a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:12.669448 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c311257-0d8a-4488-aa4b-823698a2a81e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:12.669760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c311257-0d8a-4488-aa4b-823698a2a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:12.680138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c311257-0d8a-4488-aa4b-823698a2a81e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:12.681112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c311257-0d8a-4488-aa4b-823698a2a81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:12.686893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c311257-0d8a-4488-aa4b-823698a2a81e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:12.701112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 872/1768] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:12.772145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 897/1769] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:12 2022] POST /identity/v3/users => generated 283 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:12.777069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0b57-3da4-403a-8d04-a42631cd7544 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:12.813272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0b57-3da4-403a-8d04-a42631cd7544 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:12.838210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aa532-46e7-4a1a-96b5-5ffbf375a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:12.842829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa532-46e7-4a1a-96b5-5ffbf375a6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:12.843289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa532-46e7-4a1a-96b5-5ffbf375a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:12.843713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa532-46e7-4a1a-96b5-5ffbf375a6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:12.846188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aa532-46e7-4a1a-96b5-5ffbf375a6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:12.847988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aa532-46e7-4a1a-96b5-5ffbf375a6b1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:12.872439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 873/1770] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:12.876943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c311257-0d8a-4488-aa4b-823698a2a81e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:12.896163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c311257-0d8a-4488-aa4b-823698a2a81e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:12.908673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239246ea-3086-4ea1-a304-b01617414594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:12.909469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239246ea-3086-4ea1-a304-b01617414594 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:12.909894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239246ea-3086-4ea1-a304-b01617414594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:12.917299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239246ea-3086-4ea1-a304-b01617414594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:12.918186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239246ea-3086-4ea1-a304-b01617414594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:12.958750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239246ea-3086-4ea1-a304-b01617414594 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:13.010244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aa532-46e7-4a1a-96b5-5ffbf375a6b1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:13.015524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 898/1771] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:13.033914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aa532-46e7-4a1a-96b5-5ffbf375a6b1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:13.058496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:13.058496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:13.058713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:13.058957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] PATH_INFO: `/v3/projects/f4f5f0c9a84c4444a8e2606031c6f0c1/users/90d4aebd915c478791d5e138abdff0b9/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:13.148599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f5f0c9a84c4444a8e2606031c6f0c1, user_id=90d4aebd915c478791d5e138abdff0b9, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:13.161471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:13.223513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 874/1772] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:13 2022] PUT /identity/v3/projects/f4f5f0c9a84c4444a8e2606031c6f0c1/users/90d4aebd915c478791d5e138abdff0b9/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:13.234075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd7152-d7a9-463a-9c28-35c735982969 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:13.234655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd7152-d7a9-463a-9c28-35c735982969 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:13.235281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd7152-d7a9-463a-9c28-35c735982969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:13.351699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2dbd7152-d7a9-463a-9c28-35c735982969 None None] MFA Rules not processed for user `90d4aebd915c478791d5e138abdff0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:13.361467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2dbd7152-d7a9-463a-9c28-35c735982969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:13.543754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 899/1773] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:14.703611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:14.707786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:14.980072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19ab77-d656-4f69-b078-3186f1fb0017 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:15.004413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:15.008946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:15.009258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:15.009577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:15.054165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:15.062288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:15.108777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 875/1774] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:16.679564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c83c-98c1-4d14-8841-e5749b1d2d8b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:16.680121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c83c-98c1-4d14-8841-e5749b1d2d8b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:16.680709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c83c-98c1-4d14-8841-e5749b1d2d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:16.747289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e335c83c-98c1-4d14-8841-e5749b1d2d8b None None] MFA Rules not processed for user `6838738598ce4d2186e7c0b6547868f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:16.755526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e335c83c-98c1-4d14-8841-e5749b1d2d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:16.881639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 900/1775] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:21.747745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:21.749165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:21.819810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c1df1-a013-4e8c-ae2b-5ad5dc12d30f service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:21.824912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:21.825824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:21.826098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:21.826367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] PATH_INFO: `/v3/users/3e692de595134641a293a6a11276b6a5` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:21.827548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e692de595134641a293a6a11276b6a5)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:21.829461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:21.882931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e692de595134641a293a6a11276b6a5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:21.895683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e692de595134641a293a6a11276b6a5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:21.896445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e692de595134641a293a6a11276b6a5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:21.897179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e692de595134641a293a6a11276b6a5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:21.906634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e692de595134641a293a6a11276b6a5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:21.926404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 876/1776] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:21 2022] DELETE /identity/v3/users/3e692de595134641a293a6a11276b6a5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:21.928327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb1095-2ed9-400c-8b05-f34f64a35cd3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:21.928861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb1095-2ed9-400c-8b05-f34f64a35cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:21.928861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb1095-2ed9-400c-8b05-f34f64a35cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:21.947281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e2cb1095-2ed9-400c-8b05-f34f64a35cd3 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:21.948517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e2cb1095-2ed9-400c-8b05-f34f64a35cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:22.011968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 901/1777] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:22.021944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:22.023508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:22.080800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16516c1-d931-4bf3-a67e-4419f9c53eaf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:22.087251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875510ff-eec1-4d48-a020-a63c8162c61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:22.089085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875510ff-eec1-4d48-a020-a63c8162c61b service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:22.089403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875510ff-eec1-4d48-a020-a63c8162c61b service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:22.089719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875510ff-eec1-4d48-a020-a63c8162c61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:22.100745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875510ff-eec1-4d48-a020-a63c8162c61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:22.102467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875510ff-eec1-4d48-a020-a63c8162c61b service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:22.113370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 877/1778] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:22.566520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb1095-2ed9-400c-8b05-f34f64a35cd3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:22.568158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e2cb1095-2ed9-400c-8b05-f34f64a35cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:22.574502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee36b3-dc13-48db-8edf-b92953b7869a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:22.574878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee36b3-dc13-48db-8edf-b92953b7869a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:22.575231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee36b3-dc13-48db-8edf-b92953b7869a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:22.585583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 878/1779] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:40:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:40:22.601878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62415-aefa-4a46-85f7-ec894191570b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:22.602208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62415-aefa-4a46-85f7-ec894191570b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:22.602458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd62415-aefa-4a46-85f7-ec894191570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:22.609390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb1095-2ed9-400c-8b05-f34f64a35cd3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:22.618079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:22.619071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:22.619292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:22.619560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] PATH_INFO: `/v3/projects/5ddb9edb04784fcea450ed7451658731` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:22.622229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ddb9edb04784fcea450ed7451658731)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:22.630979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:22.658582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bfd62415-aefa-4a46-85f7-ec894191570b None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:22.662527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bfd62415-aefa-4a46-85f7-ec894191570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:22.804965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ddb9edb04784fcea450ed7451658731', 'request_id': 'req-2790253a-5e1c-4505-b4aa-0a067e28d477'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:22.835139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ddb9edb04784fcea450ed7451658731', 'request_id': 'req-2790253a-5e1c-4505-b4aa-0a067e28d477'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:22.863751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ddb9edb04784fcea450ed7451658731', 'request_id': 'req-2790253a-5e1c-4505-b4aa-0a067e28d477'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:22.869058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 879/1780] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:40:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:22.886550 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd62415-aefa-4a46-85f7-ec894191570b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:22.888782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bfd62415-aefa-4a46-85f7-ec894191570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:22.902572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] The token cache is being invalidate because project 5ddb9edb04784fcea450ed7451658731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:22.902977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:22.905660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:22.910720 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 902/1781] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:22 2022] DELETE /identity/v3/projects/5ddb9edb04784fcea450ed7451658731 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:22.911940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:22.914395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd62415-aefa-4a46-85f7-ec894191570b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:22.917171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:23.059633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790253a-5e1c-4505-b4aa-0a067e28d477 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:23.066289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:23.067203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:23.067622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:23.067994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] PATH_INFO: `/v3/users/616574d1cc1a44d0a51bac7b9ef5acec` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:23.069239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616574d1cc1a44d0a51bac7b9ef5acec)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:23.069432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:23.070315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:23.071293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:23.073210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:23.073515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:23.080860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:23.101044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:23.102925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:23.116402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 880/1782] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:23.150226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616574d1cc1a44d0a51bac7b9ef5acec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:23.187639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616574d1cc1a44d0a51bac7b9ef5acec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:23.190329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616574d1cc1a44d0a51bac7b9ef5acec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:23.231395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616574d1cc1a44d0a51bac7b9ef5acec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:23.252356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616574d1cc1a44d0a51bac7b9ef5acec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:23.259827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 903/1783] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:22 2022] DELETE /identity/v3/users/616574d1cc1a44d0a51bac7b9ef5acec => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:24.244720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:24.266007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018696d0-0f46-4a40-8897-cb28ef40ebe3 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:24.354573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:24.356591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:24.460838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:24.461761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:24.462039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:24.462311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] PATH_INFO: `/v3/projects/9a56524455c8452bbf98a7024e23391e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:24.469042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a56524455c8452bbf98a7024e23391e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:24.471111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:24.553342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb61fb-2d8a-45f8-8390-e3763ed5d899 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:24.565075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:24.567580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:24.570096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:24.570926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] PATH_INFO: `/v3/users/b053c4541a9444ceae2430a6207e35ec` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:24.573463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b053c4541a9444ceae2430a6207e35ec)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:24.584455 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:24.594955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a56524455c8452bbf98a7024e23391e', 'request_id': 'req-edbabac2-8233-4eaa-8597-6dcb4e372c30'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.610993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a56524455c8452bbf98a7024e23391e', 'request_id': 'req-edbabac2-8233-4eaa-8597-6dcb4e372c30'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.628219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a56524455c8452bbf98a7024e23391e', 'request_id': 'req-edbabac2-8233-4eaa-8597-6dcb4e372c30'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.660836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] The token cache is being invalidate because project 9a56524455c8452bbf98a7024e23391e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:24.661323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.663952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-edbabac2-8233-4eaa-8597-6dcb4e372c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.667160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 881/1784] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:24 2022] DELETE /identity/v3/projects/9a56524455c8452bbf98a7024e23391e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:24.672887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ae0b-d02d-4aec-b343-29d8da781392 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:24.673387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ae0b-d02d-4aec-b343-29d8da781392 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:24.673858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ae0b-d02d-4aec-b343-29d8da781392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:24.699499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b053c4541a9444ceae2430a6207e35ec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.726399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6ee6ae0b-d02d-4aec-b343-29d8da781392 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:24.727937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6ee6ae0b-d02d-4aec-b343-29d8da781392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:24.741470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b053c4541a9444ceae2430a6207e35ec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.744508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b053c4541a9444ceae2430a6207e35ec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.761057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b053c4541a9444ceae2430a6207e35ec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.785991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f7ea12b6-fdef-4ae7-b82d-0a4e45452a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b053c4541a9444ceae2430a6207e35ec'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:24.793452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 904/1785] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:24 2022] DELETE /identity/v3/users/b053c4541a9444ceae2430a6207e35ec => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:24.798797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79518a4-cc31-4b8b-ac0d-25753925ce79 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:24.799510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79518a4-cc31-4b8b-ac0d-25753925ce79 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:24.799510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79518a4-cc31-4b8b-ac0d-25753925ce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:24.854670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d79518a4-cc31-4b8b-ac0d-25753925ce79 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:24.856632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d79518a4-cc31-4b8b-ac0d-25753925ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:24.874629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 882/1786] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:24.883125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152ae53-866e-40dd-a7bd-2269952bb858 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:24.883425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152ae53-866e-40dd-a7bd-2269952bb858 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:24.883710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152ae53-866e-40dd-a7bd-2269952bb858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:24.919905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9152ae53-866e-40dd-a7bd-2269952bb858 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:24.922012 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9152ae53-866e-40dd-a7bd-2269952bb858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:24.997869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 905/1787] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:25.010113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79518a4-cc31-4b8b-ac0d-25753925ce79 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:25.012427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d79518a4-cc31-4b8b-ac0d-25753925ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:25.049061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 883/1788] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:25.054056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152ae53-866e-40dd-a7bd-2269952bb858 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:25.072341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152ae53-866e-40dd-a7bd-2269952bb858 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:25.100022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:25.102020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.102305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.105122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.105367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79518a4-cc31-4b8b-ac0d-25753925ce79 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:25.108140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:25.108471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:25.110952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430440f-2bcc-4f0e-b37c-352a8cbb7834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:25.111843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430440f-2bcc-4f0e-b37c-352a8cbb7834 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.112361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430440f-2bcc-4f0e-b37c-352a8cbb7834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.113149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430440f-2bcc-4f0e-b37c-352a8cbb7834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.114964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:25.125692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430440f-2bcc-4f0e-b37c-352a8cbb7834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:25.127276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430440f-2bcc-4f0e-b37c-352a8cbb7834 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:25.141383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 906/1789] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:25.156980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 884/1790] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:25.161780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430440f-2bcc-4f0e-b37c-352a8cbb7834 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:25.177518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430440f-2bcc-4f0e-b37c-352a8cbb7834 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:25.191783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769f8b-2828-49a5-8764-166149d90e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:25.192719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769f8b-2828-49a5-8764-166149d90e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.193050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769f8b-2828-49a5-8764-166149d90e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.193327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769f8b-2828-49a5-8764-166149d90e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.194814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769f8b-2828-49a5-8764-166149d90e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:25.198728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769f8b-2828-49a5-8764-166149d90e7a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:25.269904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 907/1791] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:25 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:25.274222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:25.288484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fb32d-19ac-4286-be95-9fc2b9e73650 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:25.438059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a788371-2239-4ca4-ad20-68008018b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:25.439151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a788371-2239-4ca4-ad20-68008018b76a admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.439483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a788371-2239-4ca4-ad20-68008018b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.439760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a788371-2239-4ca4-ad20-68008018b76a admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.441793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a788371-2239-4ca4-ad20-68008018b76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:25.447852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a788371-2239-4ca4-ad20-68008018b76a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:25.507084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 885/1792] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:25 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:25.511819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769f8b-2828-49a5-8764-166149d90e7a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:25.525137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769f8b-2828-49a5-8764-166149d90e7a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:25.532260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85438665-06b4-4956-960e-8dc2c8842901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:25.533306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438665-06b4-4956-960e-8dc2c8842901 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.534440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438665-06b4-4956-960e-8dc2c8842901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.535670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438665-06b4-4956-960e-8dc2c8842901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.536577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85438665-06b4-4956-960e-8dc2c8842901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:25.538726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85438665-06b4-4956-960e-8dc2c8842901 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:25.553413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 908/1793] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:25.557148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a788371-2239-4ca4-ad20-68008018b76a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:25.567952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a788371-2239-4ca4-ad20-68008018b76a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:25.572686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025259a-d5c3-4c20-b17a-a457a8542524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:25.573342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025259a-d5c3-4c20-b17a-a457a8542524 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.573647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025259a-d5c3-4c20-b17a-a457a8542524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.574331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025259a-d5c3-4c20-b17a-a457a8542524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.575422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025259a-d5c3-4c20-b17a-a457a8542524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:25.577176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025259a-d5c3-4c20-b17a-a457a8542524 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:25.591349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 886/1794] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:25.592493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85438665-06b4-4956-960e-8dc2c8842901 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:25.610670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85438665-06b4-4956-960e-8dc2c8842901 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:25.617625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0705-ce0f-4584-8f06-55e9e48d1a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:25.618285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0705-ce0f-4584-8f06-55e9e48d1a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.618654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0705-ce0f-4584-8f06-55e9e48d1a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.619017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0705-ce0f-4584-8f06-55e9e48d1a4d admin admin] PATH_INFO: `/v3/projects/53af8dbc4de2421cb4bbec888b4debf6/users/0b4bdc2425f6404b95daf32dff4ce802/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.638725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c0705-ce0f-4584-8f06-55e9e48d1a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53af8dbc4de2421cb4bbec888b4debf6, user_id=0b4bdc2425f6404b95daf32dff4ce802, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:25.642277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c0705-ce0f-4584-8f06-55e9e48d1a4d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:25.666806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 909/1795] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:25 2022] PUT /identity/v3/projects/53af8dbc4de2421cb4bbec888b4debf6/users/0b4bdc2425f6404b95daf32dff4ce802/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:25.671970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7789e7e-c1c7-40cd-8772-4505d3895cfb None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.672470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7789e7e-c1c7-40cd-8772-4505d3895cfb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.672991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7789e7e-c1c7-40cd-8772-4505d3895cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.711607 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b7789e7e-c1c7-40cd-8772-4505d3895cfb None None] MFA Rules not processed for user `0b4bdc2425f6404b95daf32dff4ce802`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:25.713251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b7789e7e-c1c7-40cd-8772-4505d3895cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:25.838980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 887/1796] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:25.841065 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0705-ce0f-4584-8f06-55e9e48d1a4d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:25.941093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0705-ce0f-4584-8f06-55e9e48d1a4d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:25.947461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bd11f-e0ec-4185-9a3a-8c61e7b4ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:25.949599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bd11f-e0ec-4185-9a3a-8c61e7b4ba57 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:25.950072 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bd11f-e0ec-4185-9a3a-8c61e7b4ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:25.950552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bd11f-e0ec-4185-9a3a-8c61e7b4ba57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:25.951707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bd11f-e0ec-4185-9a3a-8c61e7b4ba57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:25.954137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bd11f-e0ec-4185-9a3a-8c61e7b4ba57 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:26.021009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 910/1797] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:25 2022] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:26.022234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7789e7e-c1c7-40cd-8772-4505d3895cfb None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:26.033788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7789e7e-c1c7-40cd-8772-4505d3895cfb None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:26.107895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5a0b-0759-413c-8820-b5e9f07b1371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:26.108583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5a0b-0759-413c-8820-b5e9f07b1371 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.108868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5a0b-0759-413c-8820-b5e9f07b1371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.109143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5a0b-0759-413c-8820-b5e9f07b1371 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.109999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5a0b-0759-413c-8820-b5e9f07b1371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:26.116853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5a0b-0759-413c-8820-b5e9f07b1371 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:26.151531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 888/1798] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:26 2022] POST /identity/v3/users => generated 301 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:26.155469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bd11f-e0ec-4185-9a3a-8c61e7b4ba57 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:26.169837 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bd11f-e0ec-4185-9a3a-8c61e7b4ba57 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:26.179315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414c3d5-0608-4b88-a2f3-0847cf005fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:26.180559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c3d5-0608-4b88-a2f3-0847cf005fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.181014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c3d5-0608-4b88-a2f3-0847cf005fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.181457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c3d5-0608-4b88-a2f3-0847cf005fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.182406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414c3d5-0608-4b88-a2f3-0847cf005fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:26.184456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414c3d5-0608-4b88-a2f3-0847cf005fc9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:26.241009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 911/1799] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:26.245267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5a0b-0759-413c-8820-b5e9f07b1371 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:26.267996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5a0b-0759-413c-8820-b5e9f07b1371 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:26.282056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:26.286574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.287888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.291222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeea49-747f-4892-a812-cbad0461d28e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.291780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeea49-747f-4892-a812-cbad0461d28e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.292181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeea49-747f-4892-a812-cbad0461d28e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.294184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 912/1800] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:40:26.294566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] PATH_INFO: `/v3/projects/e6c401e689014fcd8c4129140b928173/users/9f13f7799ec7433eb7002602d247e9cd/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.317990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282fab-dae2-40ca-8309-44970c4dff65 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.318366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282fab-dae2-40ca-8309-44970c4dff65 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.318680 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282fab-dae2-40ca-8309-44970c4dff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.411558 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c401e689014fcd8c4129140b928173, user_id=9f13f7799ec7433eb7002602d247e9cd, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:26.414444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:26.417994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-da282fab-dae2-40ca-8309-44970c4dff65 None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:26.425667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-da282fab-dae2-40ca-8309-44970c4dff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:26.475420 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 889/1801] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:26 2022] PUT /identity/v3/projects/e6c401e689014fcd8c4129140b928173/users/9f13f7799ec7433eb7002602d247e9cd/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:26.478320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:26.483034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:26.688000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 913/1802] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:40:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:26.688964 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da282fab-dae2-40ca-8309-44970c4dff65 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:26.702045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2063d90-0018-47af-aba1-29a01b088d63 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:26.717178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da282fab-dae2-40ca-8309-44970c4dff65 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:26.723603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:26.727386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa883d-e0df-4aa7-85a5-33c4926e6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:26.728241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa883d-e0df-4aa7-85a5-33c4926e6b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.728571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa883d-e0df-4aa7-85a5-33c4926e6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.728974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa883d-e0df-4aa7-85a5-33c4926e6b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.729083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.729873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa883d-e0df-4aa7-85a5-33c4926e6b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:26.730391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.730870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] PATH_INFO: `/v3/projects/76214bd85deb41ce9993ce9570fc7f13` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.732175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa883d-e0df-4aa7-85a5-33c4926e6b51 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:26.734285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] RBAC: Authorizing `identity:delete_project(project_id=76214bd85deb41ce9993ce9570fc7f13)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:26.739903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:26.763335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 914/1803] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:26.767129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa883d-e0df-4aa7-85a5-33c4926e6b51 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:26.781368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa883d-e0df-4aa7-85a5-33c4926e6b51 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:26.798043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15181d78-581f-45ab-a443-410cd0fe9091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:26.799269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15181d78-581f-45ab-a443-410cd0fe9091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.802005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15181d78-581f-45ab-a443-410cd0fe9091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.810031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15181d78-581f-45ab-a443-410cd0fe9091 admin admin] PATH_INFO: `/v3/projects/e6c401e689014fcd8c4129140b928173/users/9f13f7799ec7433eb7002602d247e9cd/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.815689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15181d78-581f-45ab-a443-410cd0fe9091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c401e689014fcd8c4129140b928173, user_id=9f13f7799ec7433eb7002602d247e9cd, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:26.818725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15181d78-581f-45ab-a443-410cd0fe9091 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:26.824135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76214bd85deb41ce9993ce9570fc7f13', 'request_id': 'req-240a4e79-eedd-4ddf-b983-9563d908387f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:26.834555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76214bd85deb41ce9993ce9570fc7f13', 'request_id': 'req-240a4e79-eedd-4ddf-b983-9563d908387f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:26.849277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76214bd85deb41ce9993ce9570fc7f13', 'request_id': 'req-240a4e79-eedd-4ddf-b983-9563d908387f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:26.854082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 915/1804] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:26 2022] PUT /identity/v3/projects/e6c401e689014fcd8c4129140b928173/users/9f13f7799ec7433eb7002602d247e9cd/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:26.865861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eddbd-1f5a-4d2d-a23b-b7b1147dff53 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:26.866150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eddbd-1f5a-4d2d-a23b-b7b1147dff53 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:26.866666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eddbd-1f5a-4d2d-a23b-b7b1147dff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:26.876159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] The token cache is being invalidate because project 76214bd85deb41ce9993ce9570fc7f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:26.876652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:26.877477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:26.879230 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 890/1805] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:26 2022] DELETE /identity/v3/projects/76214bd85deb41ce9993ce9570fc7f13 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:26.883202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:26.887781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:26.935133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8c0eddbd-1f5a-4d2d-a23b-b7b1147dff53 None None] MFA Rules not processed for user `9f13f7799ec7433eb7002602d247e9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:26.937766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8c0eddbd-1f5a-4d2d-a23b-b7b1147dff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:27.011946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a4e79-eedd-4ddf-b983-9563d908387f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:27.129005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 916/1806] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:27.175567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eddbd-1f5a-4d2d-a23b-b7b1147dff53 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:27.177093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8c0eddbd-1f5a-4d2d-a23b-b7b1147dff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:27.178417 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:27.180069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:27.180347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:27.180617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] PATH_INFO: `/v3/users/9dc0c9842f044a439357cc03936046da` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:27.188813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc0c9842f044a439357cc03936046da)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:27.190810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:27.310653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc0c9842f044a439357cc03936046da'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:27.343372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc0c9842f044a439357cc03936046da'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:27.344451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc0c9842f044a439357cc03936046da'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:27.345539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc0c9842f044a439357cc03936046da'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:27.364794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc0c9842f044a439357cc03936046da'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:27.369486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eddbd-1f5a-4d2d-a23b-b7b1147dff53 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:27.379769 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:27.385146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:27.385613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:27.390063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:27.390302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 891/1807] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:26 2022] DELETE /identity/v3/users/9dc0c9842f044a439357cc03936046da => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:27.390302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:27.393884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:27.394797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:27.426188 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:27.428214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:27.461135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 917/1808] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:27.493043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a42944-9200-47e9-abb4-f8b403e10fb0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:27.503894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:27.505511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:27.506080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:27.506567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:27.509232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:27.670265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:27.672143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:27.695730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 892/1809] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:27.841281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:27.843147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:27.858544 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9b542-f764-4805-8fe9-27f4e0424c06 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:27.940833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:27.941614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:27.941928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:27.942294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] PATH_INFO: `/v3/users/0b4bdc2425f6404b95daf32dff4ce802` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:27.943546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4bdc2425f6404b95daf32dff4ce802)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:27.945880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:27.994654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:27.996056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:28.023896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4bdc2425f6404b95daf32dff4ce802'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.025284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41873-4452-4eea-99fd-27bd1a8dae39 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:28.037157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4bdc2425f6404b95daf32dff4ce802'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.038001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4bdc2425f6404b95daf32dff4ce802'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.039781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:28.040879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.041048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.041401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] PATH_INFO: `/v3/projects/cae66812c4464acd918123403462cfc4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.043604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae66812c4464acd918123403462cfc4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:28.045960 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4bdc2425f6404b95daf32dff4ce802'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.046079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:28.054856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-348a473c-f99b-4e75-b537-2e66f9c30887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4bdc2425f6404b95daf32dff4ce802'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.062501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 918/1810] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:27 2022] DELETE /identity/v3/users/0b4bdc2425f6404b95daf32dff4ce802 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:28.066679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01344a7d-9e45-4b5a-aea2-90a2b50337a9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.067053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01344a7d-9e45-4b5a-aea2-90a2b50337a9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.067391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01344a7d-9e45-4b5a-aea2-90a2b50337a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.085795 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-01344a7d-9e45-4b5a-aea2-90a2b50337a9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:28.087104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-01344a7d-9e45-4b5a-aea2-90a2b50337a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:28.117225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae66812c4464acd918123403462cfc4', 'request_id': 'req-5cd69732-195f-48f5-ad12-938a4cfd3d69'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.123998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae66812c4464acd918123403462cfc4', 'request_id': 'req-5cd69732-195f-48f5-ad12-938a4cfd3d69'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.139524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae66812c4464acd918123403462cfc4', 'request_id': 'req-5cd69732-195f-48f5-ad12-938a4cfd3d69'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.156268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] The token cache is being invalidate because project cae66812c4464acd918123403462cfc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:28.156268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.156544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5cd69732-195f-48f5-ad12-938a4cfd3d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:28.159400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 893/1811] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:27 2022] DELETE /identity/v3/projects/cae66812c4464acd918123403462cfc4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:28.172423 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c66ac-5cf7-4999-bf32-27f41817e818 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.172709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c66ac-5cf7-4999-bf32-27f41817e818 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.172991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c66ac-5cf7-4999-bf32-27f41817e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.175158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 919/1812] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:28.194313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01344a7d-9e45-4b5a-aea2-90a2b50337a9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:28.199536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-01344a7d-9e45-4b5a-aea2-90a2b50337a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:28.205824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b86c66ac-5cf7-4999-bf32-27f41817e818 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:28.205824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b86c66ac-5cf7-4999-bf32-27f41817e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:28.276452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01344a7d-9e45-4b5a-aea2-90a2b50337a9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:28.329926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 894/1813] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:28.339006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acb99-a64d-4ece-9ada-9fae2ed62625 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.339381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acb99-a64d-4ece-9ada-9fae2ed62625 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.340221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acb99-a64d-4ece-9ada-9fae2ed62625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.354605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27976dd-c22d-4d2e-af3c-6ae8bae5ca59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:28.355367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27976dd-c22d-4d2e-af3c-6ae8bae5ca59 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.355650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27976dd-c22d-4d2e-af3c-6ae8bae5ca59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.355924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27976dd-c22d-4d2e-af3c-6ae8bae5ca59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.380932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-770acb99-a64d-4ece-9ada-9fae2ed62625 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:28.383541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-770acb99-a64d-4ece-9ada-9fae2ed62625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:28.394773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 895/1814] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:28.400040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770acb99-a64d-4ece-9ada-9fae2ed62625 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:28.408784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27976dd-c22d-4d2e-af3c-6ae8bae5ca59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:28.413632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27976dd-c22d-4d2e-af3c-6ae8bae5ca59 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:28.422591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770acb99-a64d-4ece-9ada-9fae2ed62625 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:28.434899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:28.435837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.437476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.437991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.438966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 920/1815] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:28.439754 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:28.442542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:28.444840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:28.487106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 896/1816] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:28.491281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27976dd-c22d-4d2e-af3c-6ae8bae5ca59 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:28.512860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27976dd-c22d-4d2e-af3c-6ae8bae5ca59 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:28.520878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e49aa5-8a81-47df-a535-6dab60c5449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:28.521575 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e49aa5-8a81-47df-a535-6dab60c5449d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.521864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e49aa5-8a81-47df-a535-6dab60c5449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.522143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e49aa5-8a81-47df-a535-6dab60c5449d admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.522846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e49aa5-8a81-47df-a535-6dab60c5449d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:28.525841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e49aa5-8a81-47df-a535-6dab60c5449d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:28.569403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 921/1817] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:28 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:28.574816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:28.606560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217139b-be4c-4f69-a15d-70abd40fb38f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:28.734069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3d366-66ff-46fb-84c6-9d9ae4367b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:28.734760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d366-66ff-46fb-84c6-9d9ae4367b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.735038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d366-66ff-46fb-84c6-9d9ae4367b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.735313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d366-66ff-46fb-84c6-9d9ae4367b89 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.736097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3d366-66ff-46fb-84c6-9d9ae4367b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:28.738061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3d366-66ff-46fb-84c6-9d9ae4367b89 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:28.780162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 897/1818] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:28 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:28.781966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e49aa5-8a81-47df-a535-6dab60c5449d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:28.795214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e49aa5-8a81-47df-a535-6dab60c5449d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:28.801733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c2ff0-be67-40f6-a2e9-33d8432f52a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:28.802587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c2ff0-be67-40f6-a2e9-33d8432f52a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.803653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c2ff0-be67-40f6-a2e9-33d8432f52a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.803653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c2ff0-be67-40f6-a2e9-33d8432f52a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.804270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c2ff0-be67-40f6-a2e9-33d8432f52a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:28.806138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c2ff0-be67-40f6-a2e9-33d8432f52a0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:28.824097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 922/1819] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:28.827971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3d366-66ff-46fb-84c6-9d9ae4367b89 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:28.845840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3d366-66ff-46fb-84c6-9d9ae4367b89 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:28.855124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3db19-94e5-476c-b78c-5c33842854e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:28.856033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3db19-94e5-476c-b78c-5c33842854e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.856369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3db19-94e5-476c-b78c-5c33842854e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.857159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3db19-94e5-476c-b78c-5c33842854e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.857636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3db19-94e5-476c-b78c-5c33842854e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:28.859604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3db19-94e5-476c-b78c-5c33842854e3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:28.875148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 898/1820] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:28.879141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c2ff0-be67-40f6-a2e9-33d8432f52a0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:28.891507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c2ff0-be67-40f6-a2e9-33d8432f52a0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:28.897758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:28.898656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.899075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.899686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] PATH_INFO: `/v3/projects/39e8d3ee6d3e40dfbf0d32c7270a42fa/users/4a557548cbc94c33a1d99d694d6b57c0/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.919835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e8d3ee6d3e40dfbf0d32c7270a42fa, user_id=4a557548cbc94c33a1d99d694d6b57c0, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:28.925227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:28.950904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 923/1821] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:28 2022] PUT /identity/v3/projects/39e8d3ee6d3e40dfbf0d32c7270a42fa/users/4a557548cbc94c33a1d99d694d6b57c0/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:28.953443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5461-2488-4917-abd1-053187f3eba7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:28.954501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5461-2488-4917-abd1-053187f3eba7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:28.954785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5461-2488-4917-abd1-053187f3eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:28.989261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4cdb5461-2488-4917-abd1-053187f3eba7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:28.989261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4cdb5461-2488-4917-abd1-053187f3eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:29.135276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 899/1822] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:29.151397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:29.153859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:29.259248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d663a87-05f2-48e5-9eb9-9c604dd218ed admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:29.264597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:29.265909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:29.266541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:29.266674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:29.279345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:29.281537 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:29.294321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 924/1823] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:29.930411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5461-2488-4917-abd1-053187f3eba7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:29.935923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4cdb5461-2488-4917-abd1-053187f3eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:29.968827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5461-2488-4917-abd1-053187f3eba7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:29.978434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:29.979514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:29.979798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:29.980072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] PATH_INFO: `/v3/projects/53af8dbc4de2421cb4bbec888b4debf6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:29.982290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] RBAC: Authorizing `identity:delete_project(project_id=53af8dbc4de2421cb4bbec888b4debf6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:29.984912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:30.114797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53af8dbc4de2421cb4bbec888b4debf6', 'request_id': 'req-e3ca7637-cfd3-482d-b34a-af39610efaae'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.120958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:30.124221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:30.137843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53af8dbc4de2421cb4bbec888b4debf6', 'request_id': 'req-e3ca7637-cfd3-482d-b34a-af39610efaae'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.141701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92ace-90fc-4684-b7ed-694a14c1f07d service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:30.155269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53af8dbc4de2421cb4bbec888b4debf6', 'request_id': 'req-e3ca7637-cfd3-482d-b34a-af39610efaae'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.184050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] The token cache is being invalidate because project 53af8dbc4de2421cb4bbec888b4debf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:30.184192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.185673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.191413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 900/1824] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:29 2022] DELETE /identity/v3/projects/53af8dbc4de2421cb4bbec888b4debf6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:30.192734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:30.199185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:30.211283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:30.214404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:30.215467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:30.215813 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] PATH_INFO: `/v3/users/90d4aebd915c478791d5e138abdff0b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:30.218225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d4aebd915c478791d5e138abdff0b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:30.239154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca7637-cfd3-482d-b34a-af39610efaae admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:30.248104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:30.248392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:30.249281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:30.249583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:30.249860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] PATH_INFO: `/v3/users/9f13f7799ec7433eb7002602d247e9cd` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:30.251077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f13f7799ec7433eb7002602d247e9cd)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:30.253008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:30.323959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d4aebd915c478791d5e138abdff0b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.343145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f13f7799ec7433eb7002602d247e9cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.364181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d4aebd915c478791d5e138abdff0b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.364979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d4aebd915c478791d5e138abdff0b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.372747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d4aebd915c478791d5e138abdff0b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.378537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f13f7799ec7433eb7002602d247e9cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.380100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f13f7799ec7433eb7002602d247e9cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.381057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f13f7799ec7433eb7002602d247e9cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.384410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ca04c1b2-c32a-476f-9061-92ce792e4593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d4aebd915c478791d5e138abdff0b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.397310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 925/1825] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:30 2022] DELETE /identity/v3/users/90d4aebd915c478791d5e138abdff0b9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:30.398463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f13f7799ec7433eb7002602d247e9cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:30.399012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22359ef-f58c-4b4e-98c1-d9a0a0a4434b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:30.399467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22359ef-f58c-4b4e-98c1-d9a0a0a4434b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:30.399887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22359ef-f58c-4b4e-98c1-d9a0a0a4434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:30.428845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 901/1826] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:30 2022] DELETE /identity/v3/users/9f13f7799ec7433eb7002602d247e9cd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:30.445092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a22359ef-f58c-4b4e-98c1-d9a0a0a4434b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:30.446687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a22359ef-f58c-4b4e-98c1-d9a0a0a4434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:30.522553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 926/1827] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:30.537478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:30.540755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:30.629829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4e51-8716-4495-906b-808203c7fb99 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:30.635534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:30.636469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:30.636829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:30.637273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:30.649783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:30.651785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:30.676379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 902/1828] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:30.738066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a49e4-c8ac-4470-acb0-be338b154dd6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:30.738357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a49e4-c8ac-4470-acb0-be338b154dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:30.738637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a49e4-c8ac-4470-acb0-be338b154dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:30.774737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-872a49e4-c8ac-4470-acb0-be338b154dd6 None None] MFA Rules not processed for user `4a557548cbc94c33a1d99d694d6b57c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:30.776229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-872a49e4-c8ac-4470-acb0-be338b154dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:30.877902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 927/1829] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:30.887061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:30.888756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:30.971656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74442014-91d4-4ef8-86c0-de9c8277060b service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:30.978796 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:30.979591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:30.979807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:30.980083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.002319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a49e4-c8ac-4470-acb0-be338b154dd6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.004109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-872a49e4-c8ac-4470-acb0-be338b154dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:31.007261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.009855 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.022775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 903/1830] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:31.043064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a49e4-c8ac-4470-acb0-be338b154dd6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.056402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.057407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.058513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.058513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] PATH_INFO: `/v3/projects/e6c401e689014fcd8c4129140b928173` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.059572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c401e689014fcd8c4129140b928173)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.062712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.155431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c401e689014fcd8c4129140b928173', 'request_id': 'req-298f2d54-8dfb-4c44-9b66-a1384dc6d446'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.165414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c401e689014fcd8c4129140b928173', 'request_id': 'req-298f2d54-8dfb-4c44-9b66-a1384dc6d446'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.182601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.184352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:31.186572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c401e689014fcd8c4129140b928173', 'request_id': 'req-298f2d54-8dfb-4c44-9b66-a1384dc6d446'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.205329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] The token cache is being invalidate because project e6c401e689014fcd8c4129140b928173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:31.205940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.206766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-298f2d54-8dfb-4c44-9b66-a1384dc6d446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.208585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 928/1831] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:31 2022] DELETE /identity/v3/projects/e6c401e689014fcd8c4129140b928173 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:31.214461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7d4cb-3eac-48b0-aaca-a0756e9aa27f service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.216085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298e2d-161c-4a0b-b726-e3196f919990 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.216668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298e2d-161c-4a0b-b726-e3196f919990 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.217745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298e2d-161c-4a0b-b726-e3196f919990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.246574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ab298e2d-161c-4a0b-b726-e3196f919990 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:31.247774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ab298e2d-161c-4a0b-b726-e3196f919990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:31.317320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.318508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.318992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.319104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] PATH_INFO: `/v3/projects/f4f5f0c9a84c4444a8e2606031c6f0c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.324414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f5f0c9a84c4444a8e2606031c6f0c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.330506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.392047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 929/1832] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:31.402266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758e65f-9028-46da-8dfa-88a17dda207b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.403417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758e65f-9028-46da-8dfa-88a17dda207b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.405236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758e65f-9028-46da-8dfa-88a17dda207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.440205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f5f0c9a84c4444a8e2606031c6f0c1', 'request_id': 'req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.445361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f758e65f-9028-46da-8dfa-88a17dda207b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:31.447214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f758e65f-9028-46da-8dfa-88a17dda207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:31.448621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f5f0c9a84c4444a8e2606031c6f0c1', 'request_id': 'req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.467752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f5f0c9a84c4444a8e2606031c6f0c1', 'request_id': 'req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.488976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] The token cache is being invalidate because project f4f5f0c9a84c4444a8e2606031c6f0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:31.489262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.489948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d3a5d2d3-f5dc-4992-bfb1-29739f11e208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:31.492530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 904/1833] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:31 2022] DELETE /identity/v3/projects/f4f5f0c9a84c4444a8e2606031c6f0c1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:31.498894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6762-f9b8-4f9d-8445-7e67b4da63ab None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.499260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6762-f9b8-4f9d-8445-7e67b4da63ab None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.499621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6762-f9b8-4f9d-8445-7e67b4da63ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.525679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5f3d6762-f9b8-4f9d-8445-7e67b4da63ab None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:31.526983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5f3d6762-f9b8-4f9d-8445-7e67b4da63ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:31.613596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 905/1834] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:31.620707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e8ca-9b50-4f28-9856-e27498d8e9fa None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.621009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e8ca-9b50-4f28-9856-e27498d8e9fa None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.621360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e8ca-9b50-4f28-9856-e27498d8e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.632240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 930/1835] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:31.644398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758e65f-9028-46da-8dfa-88a17dda207b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.657647 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758e65f-9028-46da-8dfa-88a17dda207b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.659131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5256e8ca-9b50-4f28-9856-e27498d8e9fa None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:31.660460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5256e8ca-9b50-4f28-9856-e27498d8e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:31.664505 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.665812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.666322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.666839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.667949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:31.668514 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.671504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.673277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 906/1836] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:31.674295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256e8ca-9b50-4f28-9856-e27498d8e9fa None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.689292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256e8ca-9b50-4f28-9856-e27498d8e9fa None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.690059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 931/1837] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:31.691359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.694680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.695456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.695844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.696162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.697035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:31.697346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.699614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.705535 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b5c04-51f0-4124-8ada-47e4cf15dd23 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.713145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec013b1-4e49-4bf4-bb7a-4a39cfd84c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.714252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 907/1838] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:31.714720 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec013b1-4e49-4bf4-bb7a-4a39cfd84c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.715238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec013b1-4e49-4bf4-bb7a-4a39cfd84c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.715516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec013b1-4e49-4bf4-bb7a-4a39cfd84c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.716241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec013b1-4e49-4bf4-bb7a-4a39cfd84c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.718375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec013b1-4e49-4bf4-bb7a-4a39cfd84c62 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.718495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.730432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2d91-6079-40b0-9e52-395abb4bbbd5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.736376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b534a-3499-4873-904c-5be61a591f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.737009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b534a-3499-4873-904c-5be61a591f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.737335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b534a-3499-4873-904c-5be61a591f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.737642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b534a-3499-4873-904c-5be61a591f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.738574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b534a-3499-4873-904c-5be61a591f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.740620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b534a-3499-4873-904c-5be61a591f32 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.751962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 932/1839] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:31 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:31.756239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec013b1-4e49-4bf4-bb7a-4a39cfd84c62 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.773988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 908/1840] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:31 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:31.775040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b534a-3499-4873-904c-5be61a591f32 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.825686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec013b1-4e49-4bf4-bb7a-4a39cfd84c62 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.840204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b534a-3499-4873-904c-5be61a591f32 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.845431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3313e2-a1d3-4445-afe9-a7962ba65647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.846131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3313e2-a1d3-4445-afe9-a7962ba65647 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.846407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3313e2-a1d3-4445-afe9-a7962ba65647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.846704 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3313e2-a1d3-4445-afe9-a7962ba65647 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.847415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3313e2-a1d3-4445-afe9-a7962ba65647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.849335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3313e2-a1d3-4445-afe9-a7962ba65647 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.874787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 909/1841] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:31 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:31.875788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3313e2-a1d3-4445-afe9-a7962ba65647 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.884984 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd4000-b229-4507-8dc1-19c6946d62df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.885666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3313e2-a1d3-4445-afe9-a7962ba65647 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.885767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4000-b229-4507-8dc1-19c6946d62df admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.886025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4000-b229-4507-8dc1-19c6946d62df admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.886289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4000-b229-4507-8dc1-19c6946d62df admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.887014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd4000-b229-4507-8dc1-19c6946d62df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.889123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd4000-b229-4507-8dc1-19c6946d62df admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.894073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf130c4-edba-458c-b314-bdae19945882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.894823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf130c4-edba-458c-b314-bdae19945882 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.895251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf130c4-edba-458c-b314-bdae19945882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.895639 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf130c4-edba-458c-b314-bdae19945882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.896437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf130c4-edba-458c-b314-bdae19945882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.898323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf130c4-edba-458c-b314-bdae19945882 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.910050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 910/1842] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:31.912092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 933/1843] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:31 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:31.914373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf130c4-edba-458c-b314-bdae19945882 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.915793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd4000-b229-4507-8dc1-19c6946d62df admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.926938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf130c4-edba-458c-b314-bdae19945882 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.929818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd4000-b229-4507-8dc1-19c6946d62df admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.932021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2cad2-337b-48be-a1f3-1f82fc08b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.932698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2cad2-337b-48be-a1f3-1f82fc08b592 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.932984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2cad2-337b-48be-a1f3-1f82fc08b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.933274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2cad2-337b-48be-a1f3-1f82fc08b592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.934024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2cad2-337b-48be-a1f3-1f82fc08b592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.935606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2cad2-337b-48be-a1f3-1f82fc08b592 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.935876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe53fe-b3a9-4d1b-8952-cfb4ed5c695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.936554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe53fe-b3a9-4d1b-8952-cfb4ed5c695b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.936838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe53fe-b3a9-4d1b-8952-cfb4ed5c695b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.937117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe53fe-b3a9-4d1b-8952-cfb4ed5c695b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.937889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe53fe-b3a9-4d1b-8952-cfb4ed5c695b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.939481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe53fe-b3a9-4d1b-8952-cfb4ed5c695b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.948969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 911/1844] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:31.950220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2cad2-337b-48be-a1f3-1f82fc08b592 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.950326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 934/1845] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:31.953784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe53fe-b3a9-4d1b-8952-cfb4ed5c695b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.960519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2cad2-337b-48be-a1f3-1f82fc08b592 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.963286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe53fe-b3a9-4d1b-8952-cfb4ed5c695b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:31.966769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0c0dc-92d1-4353-8a9c-3f3fa905ced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.967719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c0dc-92d1-4353-8a9c-3f3fa905ced8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.967902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef19cd-6e1e-465b-ba4e-fcce6efcc9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:31.968008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c0dc-92d1-4353-8a9c-3f3fa905ced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.968632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef19cd-6e1e-465b-ba4e-fcce6efcc9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:31.968737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c0dc-92d1-4353-8a9c-3f3fa905ced8 admin admin] PATH_INFO: `/v3/projects/bc6fb914e0dd470bb33287626f695bc0/users/3883f0f40a444010ba175bd627c379a9/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.969171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef19cd-6e1e-465b-ba4e-fcce6efcc9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:31.969171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef19cd-6e1e-465b-ba4e-fcce6efcc9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:31.969927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef19cd-6e1e-465b-ba4e-fcce6efcc9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.971534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef19cd-6e1e-465b-ba4e-fcce6efcc9a1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.983486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 935/1846] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:31.984793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0c0dc-92d1-4353-8a9c-3f3fa905ced8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6fb914e0dd470bb33287626f695bc0, user_id=3883f0f40a444010ba175bd627c379a9, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:31.987260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef19cd-6e1e-465b-ba4e-fcce6efcc9a1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:31.987651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0c0dc-92d1-4353-8a9c-3f3fa905ced8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:31.999290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef19cd-6e1e-465b-ba4e-fcce6efcc9a1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.001278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 912/1847] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:31 2022] PUT /identity/v3/projects/bc6fb914e0dd470bb33287626f695bc0/users/3883f0f40a444010ba175bd627c379a9/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:32.013235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393b65-3f9d-48fb-b4e4-7874aed15d9a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.013673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393b65-3f9d-48fb-b4e4-7874aed15d9a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.014006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393b65-3f9d-48fb-b4e4-7874aed15d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.041184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5c393b65-3f9d-48fb-b4e4-7874aed15d9a None None] MFA Rules not processed for user `3883f0f40a444010ba175bd627c379a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:32.042422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5c393b65-3f9d-48fb-b4e4-7874aed15d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:32.071321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618feaab-34ba-454b-9a95-62c5d5cc1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.072301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618feaab-34ba-454b-9a95-62c5d5cc1d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.072650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618feaab-34ba-454b-9a95-62c5d5cc1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.072990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618feaab-34ba-454b-9a95-62c5d5cc1d2c admin admin] PATH_INFO: `/v3/projects/68b0e9a98f94443692108bd4f128d600/users/9609d145c84942d78097785d941be3b4/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.088678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618feaab-34ba-454b-9a95-62c5d5cc1d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b0e9a98f94443692108bd4f128d600, user_id=9609d145c84942d78097785d941be3b4, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.091640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618feaab-34ba-454b-9a95-62c5d5cc1d2c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.108754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 936/1848] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:31 2022] PUT /identity/v3/projects/68b0e9a98f94443692108bd4f128d600/users/9609d145c84942d78097785d941be3b4/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:32.114811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 913/1849] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:32.119876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618feaab-34ba-454b-9a95-62c5d5cc1d2c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.120050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1191-36eb-4018-9315-385ec3c48a78 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.120203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1191-36eb-4018-9315-385ec3c48a78 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.120764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1191-36eb-4018-9315-385ec3c48a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.154127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b66d1191-36eb-4018-9315-385ec3c48a78 None None] MFA Rules not processed for user `9609d145c84942d78097785d941be3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:32.155334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b66d1191-36eb-4018-9315-385ec3c48a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:32.209128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618feaab-34ba-454b-9a95-62c5d5cc1d2c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.213104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c219c-353d-4faa-b16c-97ab42a85e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.213853 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c219c-353d-4faa-b16c-97ab42a85e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.214133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c219c-353d-4faa-b16c-97ab42a85e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.214412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c219c-353d-4faa-b16c-97ab42a85e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.215129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c219c-353d-4faa-b16c-97ab42a85e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.217197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c219c-353d-4faa-b16c-97ab42a85e85 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.239673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 914/1850] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:32.245062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d1191-36eb-4018-9315-385ec3c48a78 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.261269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d1191-36eb-4018-9315-385ec3c48a78 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.271609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171002a-44bd-4b84-bb2a-e876fcee09b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.274045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 937/1851] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/projects => generated 403 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:32.278803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c219c-353d-4faa-b16c-97ab42a85e85 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.288376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171002a-44bd-4b84-bb2a-e876fcee09b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.289932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171002a-44bd-4b84-bb2a-e876fcee09b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.290426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171002a-44bd-4b84-bb2a-e876fcee09b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.291262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171002a-44bd-4b84-bb2a-e876fcee09b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.293456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171002a-44bd-4b84-bb2a-e876fcee09b8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.336970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 915/1852] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:32.340641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171002a-44bd-4b84-bb2a-e876fcee09b8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.393679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c219c-353d-4faa-b16c-97ab42a85e85 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.414889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171002a-44bd-4b84-bb2a-e876fcee09b8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.421406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c161-0fb6-4583-8913-0339a8e8f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.422143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c161-0fb6-4583-8913-0339a8e8f59c admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.422422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c161-0fb6-4583-8913-0339a8e8f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.422787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c161-0fb6-4583-8913-0339a8e8f59c admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.423522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8c161-0fb6-4583-8913-0339a8e8f59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.425468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8c161-0fb6-4583-8913-0339a8e8f59c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.449207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 916/1853] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:32.452670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c161-0fb6-4583-8913-0339a8e8f59c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.462208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b79d5-39ba-4fb8-bf31-5fabde893c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.462995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c161-0fb6-4583-8913-0339a8e8f59c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.463278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b79d5-39ba-4fb8-bf31-5fabde893c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.463692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b79d5-39ba-4fb8-bf31-5fabde893c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.464128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b79d5-39ba-4fb8-bf31-5fabde893c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.464998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b79d5-39ba-4fb8-bf31-5fabde893c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.467060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b79d5-39ba-4fb8-bf31-5fabde893c6c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.470666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61504-2886-4311-8462-9580f4a0a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.471532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61504-2886-4311-8462-9580f4a0a345 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.472463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61504-2886-4311-8462-9580f4a0a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.473111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61504-2886-4311-8462-9580f4a0a345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.474042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61504-2886-4311-8462-9580f4a0a345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.477042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61504-2886-4311-8462-9580f4a0a345 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.496052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 917/1854] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:32.497658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61504-2886-4311-8462-9580f4a0a345 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.513210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 938/1855] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/users => generated 308 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:32.515700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b79d5-39ba-4fb8-bf31-5fabde893c6c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.524052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61504-2886-4311-8462-9580f4a0a345 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.529128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b79d5-39ba-4fb8-bf31-5fabde893c6c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.536377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f197a13-788a-4808-825c-4b39c470ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.537146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197a13-788a-4808-825c-4b39c470ebb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.537435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197a13-788a-4808-825c-4b39c470ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.537751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197a13-788a-4808-825c-4b39c470ebb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.537972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da493815-61be-4218-bb85-9c308949ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.538498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f197a13-788a-4808-825c-4b39c470ebb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.538683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da493815-61be-4218-bb85-9c308949ad4d admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.538941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da493815-61be-4218-bb85-9c308949ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.539331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da493815-61be-4218-bb85-9c308949ad4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.539943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da493815-61be-4218-bb85-9c308949ad4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.540173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f197a13-788a-4808-825c-4b39c470ebb0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.541560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da493815-61be-4218-bb85-9c308949ad4d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.569598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 939/1856] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:32.571995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f197a13-788a-4808-825c-4b39c470ebb0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.576342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 918/1857] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:32.577266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da493815-61be-4218-bb85-9c308949ad4d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.591018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f197a13-788a-4808-825c-4b39c470ebb0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.601049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da493815-61be-4218-bb85-9c308949ad4d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.602341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1e501-0bea-40b1-abbe-7099681f75c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.603385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e501-0bea-40b1-abbe-7099681f75c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.612141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.613042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.613318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.613616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] PATH_INFO: `/v3/projects/d73e9655a2ce4b6dacf1ba2248f85bb4/users/416d91103a344a5cba00542c7baf79cc/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.613863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e501-0bea-40b1-abbe-7099681f75c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.614451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1e501-0bea-40b1-abbe-7099681f75c1 admin admin] PATH_INFO: `/v3/projects/42404dc774a240898bfcfbd45d08fefa/users/9bd5a5a10a314f8eb59a86422d02ede2/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.634081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73e9655a2ce4b6dacf1ba2248f85bb4, user_id=416d91103a344a5cba00542c7baf79cc, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.638761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.657692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1e501-0bea-40b1-abbe-7099681f75c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42404dc774a240898bfcfbd45d08fefa, user_id=9bd5a5a10a314f8eb59a86422d02ede2, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.660869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1e501-0bea-40b1-abbe-7099681f75c1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.670137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 919/1858] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:32 2022] PUT /identity/v3/projects/d73e9655a2ce4b6dacf1ba2248f85bb4/users/416d91103a344a5cba00542c7baf79cc/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:32.671347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.672981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:32.691865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 940/1859] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:32 2022] PUT /identity/v3/projects/42404dc774a240898bfcfbd45d08fefa/users/9bd5a5a10a314f8eb59a86422d02ede2/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:32.694922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62f12-4c55-46a1-a1d5-87d4a01ab635 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.694922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62f12-4c55-46a1-a1d5-87d4a01ab635 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.694922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62f12-4c55-46a1-a1d5-87d4a01ab635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.743574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9ea62f12-4c55-46a1-a1d5-87d4a01ab635 None None] MFA Rules not processed for user `416d91103a344a5cba00542c7baf79cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:32.744337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ea62f12-4c55-46a1-a1d5-87d4a01ab635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:32.758527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33f15c-ca5a-4af3-a562-4dd3ea385694 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.841353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 941/1860] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:32.846064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea62f12-4c55-46a1-a1d5-87d4a01ab635 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.859078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.859975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.860252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.860525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] PATH_INFO: `/v3/users/82f5da74791b457a97603bbd0da9152d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.861798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f5da74791b457a97603bbd0da9152d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.864048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.932542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea62f12-4c55-46a1-a1d5-87d4a01ab635 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:32.935100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f5da74791b457a97603bbd0da9152d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:32.938220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11fe2-f862-4c10-8ad7-cfa7852b8194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:32.939068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11fe2-f862-4c10-8ad7-cfa7852b8194 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.939604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11fe2-f862-4c10-8ad7-cfa7852b8194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.940162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11fe2-f862-4c10-8ad7-cfa7852b8194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.941389 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11fe2-f862-4c10-8ad7-cfa7852b8194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:32.945030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11fe2-f862-4c10-8ad7-cfa7852b8194 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:32.949513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f5da74791b457a97603bbd0da9152d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:32.950397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f5da74791b457a97603bbd0da9152d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:32.954025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f5da74791b457a97603bbd0da9152d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:32.959167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 942/1861] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:32.960834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0717-0595-4095-b45e-18b503fcbe00 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:32.961351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0717-0595-4095-b45e-18b503fcbe00 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:32.961847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0717-0595-4095-b45e-18b503fcbe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:32.965656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f5da74791b457a97603bbd0da9152d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:32.981308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cd8c0717-0595-4095-b45e-18b503fcbe00 None None] MFA Rules not processed for user `4a557548cbc94c33a1d99d694d6b57c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:32.982911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cd8c0717-0595-4095-b45e-18b503fcbe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:32.983463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 920/1862] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:32 2022] DELETE /identity/v3/users/82f5da74791b457a97603bbd0da9152d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:32.984583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:32.986634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:33.049572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 943/1863] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:33.050638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c0717-0595-4095-b45e-18b503fcbe00 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.052281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cd8c0717-0595-4095-b45e-18b503fcbe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:33.087040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3c6fd-7676-4e8d-9fb6-09d93af4c23d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.108846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d881c-27dc-4778-b423-740476d5a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.110275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d881c-27dc-4778-b423-740476d5a610 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.110535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d881c-27dc-4778-b423-740476d5a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.110881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d881c-27dc-4778-b423-740476d5a610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.112696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d881c-27dc-4778-b423-740476d5a610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.114850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d881c-27dc-4778-b423-740476d5a610 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.137690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c0717-0595-4095-b45e-18b503fcbe00 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.146157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902b456-439e-4ff2-aaab-26b9115ee95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.147087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b456-439e-4ff2-aaab-26b9115ee95a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.147385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b456-439e-4ff2-aaab-26b9115ee95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.147627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b456-439e-4ff2-aaab-26b9115ee95a admin admin] PATH_INFO: `/v3/projects/42404dc774a240898bfcfbd45d08fefa/users/9bd5a5a10a314f8eb59a86422d02ede2/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.150526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 921/1864] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:32 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:33.153866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb369-ea72-4690-86b0-18c3d973d273 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.154160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb369-ea72-4690-86b0-18c3d973d273 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.154438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb369-ea72-4690-86b0-18c3d973d273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.156999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902b456-439e-4ff2-aaab-26b9115ee95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=42404dc774a240898bfcfbd45d08fefa, user_id=9bd5a5a10a314f8eb59a86422d02ede2, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.160736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902b456-439e-4ff2-aaab-26b9115ee95a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.172137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 944/1865] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:33 2022] PUT /identity/v3/projects/42404dc774a240898bfcfbd45d08fefa/users/9bd5a5a10a314f8eb59a86422d02ede2/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:33.173008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902b456-439e-4ff2-aaab-26b9115ee95a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.187324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e0acb369-ea72-4690-86b0-18c3d973d273 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:33.188691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e0acb369-ea72-4690-86b0-18c3d973d273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:33.298101 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 922/1866] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:33.300902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d387-e123-4ff3-8798-aaf3ffdaaa4b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.302165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d387-e123-4ff3-8798-aaf3ffdaaa4b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.303985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d387-e123-4ff3-8798-aaf3ffdaaa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.330607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902b456-439e-4ff2-aaab-26b9115ee95a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.357134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.359697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.360058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.360437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.361356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.363970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.372964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5d61d387-e123-4ff3-8798-aaf3ffdaaa4b None None] MFA Rules not processed for user `9bd5a5a10a314f8eb59a86422d02ede2`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:33.374522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5d61d387-e123-4ff3-8798-aaf3ffdaaa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:33.388467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 945/1867] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:33 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:33.389659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.392590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:33.453141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edc6b1-9da8-4c32-87b4-1ba7c0f1c981 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.457786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 923/1868] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:33.458253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.459062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.459241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61d387-e123-4ff3-8798-aaf3ffdaaa4b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.459622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.460124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.473486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61d387-e123-4ff3-8798-aaf3ffdaaa4b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.478883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.479254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc82d3-b1c3-410e-805d-aa72cbeff37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.479989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc82d3-b1c3-410e-805d-aa72cbeff37b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.480265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc82d3-b1c3-410e-805d-aa72cbeff37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.480534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc82d3-b1c3-410e-805d-aa72cbeff37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.481208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.481333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc82d3-b1c3-410e-805d-aa72cbeff37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.482956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc82d3-b1c3-410e-805d-aa72cbeff37b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.492296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 946/1869] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:33.493276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 924/1870] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:33.493595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.495102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:33.498366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc82d3-b1c3-410e-805d-aa72cbeff37b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.509445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc82d3-b1c3-410e-805d-aa72cbeff37b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.514765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf21eae-22d0-44d4-bc96-a303ca29ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.515831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21eae-22d0-44d4-bc96-a303ca29ad18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.516114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21eae-22d0-44d4-bc96-a303ca29ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.516385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21eae-22d0-44d4-bc96-a303ca29ad18 admin admin] PATH_INFO: `/v3/projects/662cff4e79f44fddb92a3bd9336eb513/users/54ce7c8587e4448cb44345ec77d59a92/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.532477 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf21eae-22d0-44d4-bc96-a303ca29ad18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662cff4e79f44fddb92a3bd9336eb513, user_id=54ce7c8587e4448cb44345ec77d59a92, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.535580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf21eae-22d0-44d4-bc96-a303ca29ad18 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.559047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 925/1871] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:33 2022] PUT /identity/v3/projects/662cff4e79f44fddb92a3bd9336eb513/users/54ce7c8587e4448cb44345ec77d59a92/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:33.564135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf21eae-22d0-44d4-bc96-a303ca29ad18 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.571162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400469b2-5e9b-4296-b1cf-9071067d285b service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.634806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.635526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.635909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.636190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.640358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf21eae-22d0-44d4-bc96-a303ca29ad18 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.648492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5807-a06f-464e-9959-86f62a68b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.649579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5807-a06f-464e-9959-86f62a68b251 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.650042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5807-a06f-464e-9959-86f62a68b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.650330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5807-a06f-464e-9959-86f62a68b251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.651400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b5807-a06f-464e-9959-86f62a68b251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.653212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b5807-a06f-464e-9959-86f62a68b251 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.668593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 926/1872] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:33.670992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5807-a06f-464e-9959-86f62a68b251 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.681082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5807-a06f-464e-9959-86f62a68b251 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.687822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3662-c54c-4bbd-ba95-f443343e7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:33.689108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3662-c54c-4bbd-ba95-f443343e7f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.690026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3662-c54c-4bbd-ba95-f443343e7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.690676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3662-c54c-4bbd-ba95-f443343e7f5f admin admin] PATH_INFO: `/v3/projects/662cff4e79f44fddb92a3bd9336eb513/users/54ce7c8587e4448cb44345ec77d59a92/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.694864 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e3662-c54c-4bbd-ba95-f443343e7f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=662cff4e79f44fddb92a3bd9336eb513, user_id=54ce7c8587e4448cb44345ec77d59a92, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.702187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e3662-c54c-4bbd-ba95-f443343e7f5f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.716254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 927/1873] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:33 2022] PUT /identity/v3/projects/662cff4e79f44fddb92a3bd9336eb513/users/54ce7c8587e4448cb44345ec77d59a92/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:33.726470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65601-d7cc-4427-a94e-991036b52d77 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:33.726761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65601-d7cc-4427-a94e-991036b52d77 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:33.727040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65601-d7cc-4427-a94e-991036b52d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:33.733654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:33.735531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:33.748223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 947/1874] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:33.759481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-40b65601-d7cc-4427-a94e-991036b52d77 None None] MFA Rules not processed for user `54ce7c8587e4448cb44345ec77d59a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:33.761439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-40b65601-d7cc-4427-a94e-991036b52d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:33.869654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 928/1875] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:33.914304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:33.915784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:33.928453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15e44-7ecb-4867-807a-3d7ad11eff61 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:33.960742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65601-d7cc-4427-a94e-991036b52d77 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:34.040599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:34.041683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:34.042021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:34.042229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:34.063013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:34.065704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:34.103758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 948/1876] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:34.109855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:34.114565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:34.133204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65601-d7cc-4427-a94e-991036b52d77 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:34.163207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:34.164116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:34.164398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:34.164674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] PATH_INFO: `/v3/users/3883f0f40a444010ba175bd627c379a9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:34.169981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f45ff-15dd-4e8e-aa7b-e72fa300cecc service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:34.171633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3883f0f40a444010ba175bd627c379a9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:34.176553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:34.179271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:34.180077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:34.180985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] PATH_INFO: `/v3/projects/f9b5977c33a84dcf9a4df5e1d853786f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:34.183394 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:34.184048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b5977c33a84dcf9a4df5e1d853786f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:34.190171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:34.281029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3883f0f40a444010ba175bd627c379a9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.300344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3883f0f40a444010ba175bd627c379a9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.301335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3883f0f40a444010ba175bd627c379a9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.302051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3883f0f40a444010ba175bd627c379a9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.306293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b5977c33a84dcf9a4df5e1d853786f', 'request_id': 'req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.311036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3883f0f40a444010ba175bd627c379a9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.321048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b5977c33a84dcf9a4df5e1d853786f', 'request_id': 'req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.330082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 929/1877] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:33 2022] DELETE /identity/v3/users/3883f0f40a444010ba175bd627c379a9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:34.334597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:34.336772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:34.338414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b5977c33a84dcf9a4df5e1d853786f', 'request_id': 'req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.360521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] The token cache is being invalidate because project f9b5977c33a84dcf9a4df5e1d853786f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:34.361511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.362851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8f96bf6-628d-4f47-9e4c-9af9244c1b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.370436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 949/1878] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:34 2022] DELETE /identity/v3/projects/f9b5977c33a84dcf9a4df5e1d853786f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:34.371897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae6c3-abfb-49c7-aa16-c35c8749b772 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:34.372186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae6c3-abfb-49c7-aa16-c35c8749b772 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:34.374625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae6c3-abfb-49c7-aa16-c35c8749b772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:34.425602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4a0ae6c3-abfb-49c7-aa16-c35c8749b772 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:34.426347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4a0ae6c3-abfb-49c7-aa16-c35c8749b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:34.482661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405021-7dbe-4d4c-8574-8f734dbf7389 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:34.486552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:34.487218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:34.487499 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:34.487781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:34.489666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:34.501989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 950/1879] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:34.503181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae6c3-abfb-49c7-aa16-c35c8749b772 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:34.505044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4a0ae6c3-abfb-49c7-aa16-c35c8749b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:34.517194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae6c3-abfb-49c7-aa16-c35c8749b772 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:34.523276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:34.524168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:34.524445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:34.524714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] PATH_INFO: `/v3/users/d325fcf04b6747239f2bdd53082179c2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:34.525940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d325fcf04b6747239f2bdd53082179c2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:34.527874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:34.564699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:34.564699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:34.575464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 930/1880] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:34.576205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:34.577843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:34.595192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd325fcf04b6747239f2bdd53082179c2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.609481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd325fcf04b6747239f2bdd53082179c2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.610232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd325fcf04b6747239f2bdd53082179c2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.619117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd325fcf04b6747239f2bdd53082179c2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.632368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd325fcf04b6747239f2bdd53082179c2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:34.636064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 951/1881] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:34 2022] DELETE /identity/v3/users/d325fcf04b6747239f2bdd53082179c2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:34.645334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8491a1-d2e5-4784-b2c1-a2868236ad29 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:34.694632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:34.695454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:34.695591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:34.695820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:34.697885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:34.764772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:34.766493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:34.777981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 931/1882] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:35.027094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:35.028984 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:35.055833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385414c-4114-4eb6-a2e4-8cf88042ee1a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:35.071574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:35.081922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:35.082223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:35.082532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] PATH_INFO: `/v3/projects/bcc626a2b93d4d2297dd21b12fec7d94` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:35.086848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc626a2b93d4d2297dd21b12fec7d94)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:35.091160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:35.263170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:35.264139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc626a2b93d4d2297dd21b12fec7d94', 'request_id': 'req-68a7ce93-c846-428b-8713-95c81a85f958'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.264711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:35.282181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372727-6a28-42f2-befc-9c4ef581b208 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:35.307484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc626a2b93d4d2297dd21b12fec7d94', 'request_id': 'req-68a7ce93-c846-428b-8713-95c81a85f958'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.341874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc626a2b93d4d2297dd21b12fec7d94', 'request_id': 'req-68a7ce93-c846-428b-8713-95c81a85f958'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.369395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] The token cache is being invalidate because project bcc626a2b93d4d2297dd21b12fec7d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:35.369879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.374809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-68a7ce93-c846-428b-8713-95c81a85f958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.381649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 952/1883] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:35 2022] DELETE /identity/v3/projects/bcc626a2b93d4d2297dd21b12fec7d94 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:35.383272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20def2-de62-4a25-8741-4fd7a1fd6aba None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:35.383457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20def2-de62-4a25-8741-4fd7a1fd6aba None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:35.383725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20def2-de62-4a25-8741-4fd7a1fd6aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:35.407977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ff20def2-de62-4a25-8741-4fd7a1fd6aba None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:35.409770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ff20def2-de62-4a25-8741-4fd7a1fd6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:35.426797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:35.430717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:35.431509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:35.431795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] PATH_INFO: `/v3/projects/bc6fb914e0dd470bb33287626f695bc0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:35.436543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6fb914e0dd470bb33287626f695bc0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:35.447123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:35.501609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 953/1884] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:35.511457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa156dc1-28f1-41fc-b4aa-9ae751bf6325 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:35.511951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa156dc1-28f1-41fc-b4aa-9ae751bf6325 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:35.512453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa156dc1-28f1-41fc-b4aa-9ae751bf6325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:35.537569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6fb914e0dd470bb33287626f695bc0', 'request_id': 'req-f14be2e0-176a-4677-b864-a456c4a7615c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.538186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-aa156dc1-28f1-41fc-b4aa-9ae751bf6325 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:35.541200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aa156dc1-28f1-41fc-b4aa-9ae751bf6325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:35.545095 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6fb914e0dd470bb33287626f695bc0', 'request_id': 'req-f14be2e0-176a-4677-b864-a456c4a7615c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.558823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6fb914e0dd470bb33287626f695bc0', 'request_id': 'req-f14be2e0-176a-4677-b864-a456c4a7615c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.573274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] The token cache is being invalidate because project bc6fb914e0dd470bb33287626f695bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:35.573274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.573679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.575739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 932/1885] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:35 2022] DELETE /identity/v3/projects/bc6fb914e0dd470bb33287626f695bc0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:35.580096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:35.585516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:35.644989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 954/1886] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:35.649403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa156dc1-28f1-41fc-b4aa-9ae751bf6325 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:35.667259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa156dc1-28f1-41fc-b4aa-9ae751bf6325 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:35.673417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:35.675055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:35.675373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:35.675929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:35.677006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:35.677420 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:35.679341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:35.695842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be2e0-176a-4677-b864-a456c4a7615c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:35.699738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 955/1887] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:40:35.707694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:35.708439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:35.708654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:35.709038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:35.709659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] PATH_INFO: `/v3/users/9bd5a5a10a314f8eb59a86422d02ede2` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:35.712379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd5a5a10a314f8eb59a86422d02ede2)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:35.714835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:35.723198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202824ae-cccc-4322-93b1-a8667ae8aef0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:35.729301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee494acb-8446-4b75-99d7-dbf88ef4b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:35.730787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee494acb-8446-4b75-99d7-dbf88ef4b2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:35.731077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee494acb-8446-4b75-99d7-dbf88ef4b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:35.731509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee494acb-8446-4b75-99d7-dbf88ef4b2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:35.732752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee494acb-8446-4b75-99d7-dbf88ef4b2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:35.735585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee494acb-8446-4b75-99d7-dbf88ef4b2b9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:35.806422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 956/1888] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:35 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:35.807637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee494acb-8446-4b75-99d7-dbf88ef4b2b9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:35.819465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd5a5a10a314f8eb59a86422d02ede2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.835553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd5a5a10a314f8eb59a86422d02ede2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.836288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd5a5a10a314f8eb59a86422d02ede2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.837362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd5a5a10a314f8eb59a86422d02ede2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.846536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd5a5a10a314f8eb59a86422d02ede2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:35.869834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 933/1889] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:35 2022] DELETE /identity/v3/users/9bd5a5a10a314f8eb59a86422d02ede2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:35.897787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee494acb-8446-4b75-99d7-dbf88ef4b2b9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:35.973220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e13ad-2dbf-487d-b798-d32226ec9b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:35.973943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e13ad-2dbf-487d-b798-d32226ec9b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:35.974228 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e13ad-2dbf-487d-b798-d32226ec9b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:35.974503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e13ad-2dbf-487d-b798-d32226ec9b37 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:35.975201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e13ad-2dbf-487d-b798-d32226ec9b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:35.977130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e13ad-2dbf-487d-b798-d32226ec9b37 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.004980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 957/1890] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:35 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:36.010046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.011610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:36.026835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8250e3-1c64-443e-a200-407ec35a643a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.038822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96d9c2-fc99-4b93-af79-9f03bab6496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.040887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d9c2-fc99-4b93-af79-9f03bab6496e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.041177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d9c2-fc99-4b93-af79-9f03bab6496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.041440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d9c2-fc99-4b93-af79-9f03bab6496e admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.042214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96d9c2-fc99-4b93-af79-9f03bab6496e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.049537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96d9c2-fc99-4b93-af79-9f03bab6496e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.069502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 934/1891] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:36.073618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e13ad-2dbf-487d-b798-d32226ec9b37 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.086238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e13ad-2dbf-487d-b798-d32226ec9b37 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.100687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de711d9e-cd7e-4154-88b1-ee9e9e25b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.101375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711d9e-cd7e-4154-88b1-ee9e9e25b489 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.101678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711d9e-cd7e-4154-88b1-ee9e9e25b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.101955 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711d9e-cd7e-4154-88b1-ee9e9e25b489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.102931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de711d9e-cd7e-4154-88b1-ee9e9e25b489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.104285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de711d9e-cd7e-4154-88b1-ee9e9e25b489 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.115121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 958/1892] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:36.119986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96d9c2-fc99-4b93-af79-9f03bab6496e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.133362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96d9c2-fc99-4b93-af79-9f03bab6496e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.139450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.140681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.141171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.150085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] PATH_INFO: `/v3/projects/2e0cf8be458042299ea8aeab2d5cd643/users/1433d216975745a19e5aa31cc52007b4/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.179407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0cf8be458042299ea8aeab2d5cd643, user_id=1433d216975745a19e5aa31cc52007b4, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.182323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.197092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 935/1893] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:36 2022] PUT /identity/v3/projects/2e0cf8be458042299ea8aeab2d5cd643/users/1433d216975745a19e5aa31cc52007b4/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:36.208614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22799a-24fe-4414-9401-b02028399722 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.208906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22799a-24fe-4414-9401-b02028399722 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.209181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22799a-24fe-4414-9401-b02028399722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.215552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.218518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:36.250627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0f22799a-24fe-4414-9401-b02028399722 None None] MFA Rules not processed for user `1433d216975745a19e5aa31cc52007b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:36.255512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0f22799a-24fe-4414-9401-b02028399722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:36.312653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41932f0-4407-4ba1-9cea-4aa95bb2eaf3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.319324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.320199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.320482 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.320853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] PATH_INFO: `/v3/projects/42404dc774a240898bfcfbd45d08fefa` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.322659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] RBAC: Authorizing `identity:delete_project(project_id=42404dc774a240898bfcfbd45d08fefa)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.326169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.357377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 959/1894] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:36.361948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22799a-24fe-4414-9401-b02028399722 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.373783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22799a-24fe-4414-9401-b02028399722 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.387746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42404dc774a240898bfcfbd45d08fefa', 'request_id': 'req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:36.394093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42404dc774a240898bfcfbd45d08fefa', 'request_id': 'req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:36.405122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42404dc774a240898bfcfbd45d08fefa', 'request_id': 'req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:36.417820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] The token cache is being invalidate because project 42404dc774a240898bfcfbd45d08fefa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:36.418104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:36.418773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fb53afb7-b4fa-4f47-81a6-0ed24eafaded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:36.420355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 936/1895] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:36 2022] DELETE /identity/v3/projects/42404dc774a240898bfcfbd45d08fefa => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:36.425613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe5ea-8723-42f3-b6ac-b3d6da18212a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.426243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe5ea-8723-42f3-b6ac-b3d6da18212a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.426527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe5ea-8723-42f3-b6ac-b3d6da18212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.434974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.435640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.435918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.436189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.436877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.438823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.448794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fbffe5ea-8723-42f3-b6ac-b3d6da18212a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:36.450016 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fbffe5ea-8723-42f3-b6ac-b3d6da18212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:36.458585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 937/1896] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:36.467315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae735481-dfe7-437a-960e-4eb9f61a75ee None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.467636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae735481-dfe7-437a-960e-4eb9f61a75ee None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.467913 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae735481-dfe7-437a-960e-4eb9f61a75ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.471308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 960/1897] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:36.472231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.473922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:36.487754 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ae735481-dfe7-437a-960e-4eb9f61a75ee None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:36.489227 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ae735481-dfe7-437a-960e-4eb9f61a75ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:36.538023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0082-9d5b-4d84-961a-651eb6dc4cd2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.542677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66900dc6-a1cb-42af-bbe3-c07d9850a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.543437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900dc6-a1cb-42af-bbe3-c07d9850a149 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.543719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900dc6-a1cb-42af-bbe3-c07d9850a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.543999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900dc6-a1cb-42af-bbe3-c07d9850a149 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.544682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66900dc6-a1cb-42af-bbe3-c07d9850a149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.546944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66900dc6-a1cb-42af-bbe3-c07d9850a149 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.547485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 938/1898] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:36.551528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae735481-dfe7-437a-960e-4eb9f61a75ee None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.560268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae735481-dfe7-437a-960e-4eb9f61a75ee None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.566036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.566720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.567071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.567338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.567815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 961/1899] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:36.568048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:36.568351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.570033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.571741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66900dc6-a1cb-42af-bbe3-c07d9850a149 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.581798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 939/1900] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:40:36.583980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66900dc6-a1cb-42af-bbe3-c07d9850a149 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.585869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.588961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d958f7-50a8-4475-8531-6f0008140506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.589657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d958f7-50a8-4475-8531-6f0008140506 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.589989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d958f7-50a8-4475-8531-6f0008140506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.590310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d958f7-50a8-4475-8531-6f0008140506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.591071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d958f7-50a8-4475-8531-6f0008140506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.592663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d958f7-50a8-4475-8531-6f0008140506 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.595327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d179e42-81ad-4e25-b5d7-a88e2186c41d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.600406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515c316-f9f6-4492-9977-3047b7ef1cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.601049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c316-f9f6-4492-9977-3047b7ef1cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.601322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c316-f9f6-4492-9977-3047b7ef1cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.601625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c316-f9f6-4492-9977-3047b7ef1cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.602302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515c316-f9f6-4492-9977-3047b7ef1cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.604180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 962/1901] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:36.604287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515c316-f9f6-4492-9977-3047b7ef1cf2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.608043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d958f7-50a8-4475-8531-6f0008140506 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.617496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d958f7-50a8-4475-8531-6f0008140506 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.622080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ce23-46d0-43ce-88fa-41804204821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.622951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ce23-46d0-43ce-88fa-41804204821c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.623224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ce23-46d0-43ce-88fa-41804204821c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.623676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ce23-46d0-43ce-88fa-41804204821c admin admin] PATH_INFO: `/v3/projects/776e99cc72034e529c2ea71673b542f8/users/74f25e7ee62a4d9c932253e22962948d/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.629609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 940/1902] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:36.633803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515c316-f9f6-4492-9977-3047b7ef1cf2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.642503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ce23-46d0-43ce-88fa-41804204821c admin admin] RBAC: Authorizing `identity:create_grant(project_id=776e99cc72034e529c2ea71673b542f8, user_id=74f25e7ee62a4d9c932253e22962948d, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.645195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ce23-46d0-43ce-88fa-41804204821c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.658998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 963/1903] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:36 2022] PUT /identity/v3/projects/776e99cc72034e529c2ea71673b542f8/users/74f25e7ee62a4d9c932253e22962948d/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:36.662846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ce23-46d0-43ce-88fa-41804204821c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.694796 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515c316-f9f6-4492-9977-3047b7ef1cf2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.721943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ce23-46d0-43ce-88fa-41804204821c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.726585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae69a3-3154-4838-8dc5-ed655127d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.727254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae69a3-3154-4838-8dc5-ed655127d35b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.727536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae69a3-3154-4838-8dc5-ed655127d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.727809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae69a3-3154-4838-8dc5-ed655127d35b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.728534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae69a3-3154-4838-8dc5-ed655127d35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.730313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae69a3-3154-4838-8dc5-ed655127d35b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.743553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 964/1904] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:36.744741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae69a3-3154-4838-8dc5-ed655127d35b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.747343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a6ff-aee0-4598-9950-0e0e10bf2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.748014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a6ff-aee0-4598-9950-0e0e10bf2a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.748289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a6ff-aee0-4598-9950-0e0e10bf2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.748560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a6ff-aee0-4598-9950-0e0e10bf2a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.749232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a6ff-aee0-4598-9950-0e0e10bf2a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.751211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a6ff-aee0-4598-9950-0e0e10bf2a0a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.754328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae69a3-3154-4838-8dc5-ed655127d35b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.759086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9e5c6-c05a-458e-aa71-57a303216da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.759876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9e5c6-c05a-458e-aa71-57a303216da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.760171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9e5c6-c05a-458e-aa71-57a303216da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.760443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9e5c6-c05a-458e-aa71-57a303216da8 admin admin] PATH_INFO: `/v3/projects/776e99cc72034e529c2ea71673b542f8/users/74f25e7ee62a4d9c932253e22962948d/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.762556 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9e5c6-c05a-458e-aa71-57a303216da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776e99cc72034e529c2ea71673b542f8, user_id=74f25e7ee62a4d9c932253e22962948d, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.765852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9e5c6-c05a-458e-aa71-57a303216da8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.774024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 941/1905] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/users => generated 302 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:36.777900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 965/1906] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:36 2022] PUT /identity/v3/projects/776e99cc72034e529c2ea71673b542f8/users/74f25e7ee62a4d9c932253e22962948d/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:36.778071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a6ff-aee0-4598-9950-0e0e10bf2a0a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.790249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873226-038f-4995-bb56-754b0e9a868b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.790536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873226-038f-4995-bb56-754b0e9a868b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.790851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873226-038f-4995-bb56-754b0e9a868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.791864 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a6ff-aee0-4598-9950-0e0e10bf2a0a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.819942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6f873226-038f-4995-bb56-754b0e9a868b None None] MFA Rules not processed for user `74f25e7ee62a4d9c932253e22962948d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:36.821266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6f873226-038f-4995-bb56-754b0e9a868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:36.850475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9304313-55b5-4ca6-b6f0-c38201281e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.851562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9304313-55b5-4ca6-b6f0-c38201281e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.851678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9304313-55b5-4ca6-b6f0-c38201281e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.852048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9304313-55b5-4ca6-b6f0-c38201281e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.852848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9304313-55b5-4ca6-b6f0-c38201281e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.854493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9304313-55b5-4ca6-b6f0-c38201281e17 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.865597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 942/1907] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:36.870563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9304313-55b5-4ca6-b6f0-c38201281e17 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.880233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9304313-55b5-4ca6-b6f0-c38201281e17 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.885677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054604a-2871-4fda-8436-32cfc130dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.886337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054604a-2871-4fda-8436-32cfc130dc35 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.886635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054604a-2871-4fda-8436-32cfc130dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.886906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054604a-2871-4fda-8436-32cfc130dc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.887653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054604a-2871-4fda-8436-32cfc130dc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.889124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 966/1908] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:36.889368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054604a-2871-4fda-8436-32cfc130dc35 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.899966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873226-038f-4995-bb56-754b0e9a868b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.901405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6f873226-038f-4995-bb56-754b0e9a868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:36.901818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 943/1909] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:36.903813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054604a-2871-4fda-8436-32cfc130dc35 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:36.915753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054604a-2871-4fda-8436-32cfc130dc35 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.920849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3babd-1b1f-4575-8be6-b2e0ccb4cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:36.922314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3babd-1b1f-4575-8be6-b2e0ccb4cfbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.922592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3babd-1b1f-4575-8be6-b2e0ccb4cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.922867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3babd-1b1f-4575-8be6-b2e0ccb4cfbc admin admin] PATH_INFO: `/v3/projects/41d2d86a107d4a85b93b469cf4d09910/users/f6b6567507174da0968f7a022bc06d57/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.939037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3babd-1b1f-4575-8be6-b2e0ccb4cfbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d2d86a107d4a85b93b469cf4d09910, user_id=f6b6567507174da0968f7a022bc06d57, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:36.941870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3babd-1b1f-4575-8be6-b2e0ccb4cfbc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:36.959371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873226-038f-4995-bb56-754b0e9a868b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:36.960455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 944/1910] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:36 2022] PUT /identity/v3/projects/41d2d86a107d4a85b93b469cf4d09910/users/f6b6567507174da0968f7a022bc06d57/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:36.970281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2870e5-8b83-4f58-90c3-8858e4068773 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:36.970573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2870e5-8b83-4f58-90c3-8858e4068773 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:36.970849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2870e5-8b83-4f58-90c3-8858e4068773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:36.987165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5c2870e5-8b83-4f58-90c3-8858e4068773 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:36.988379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5c2870e5-8b83-4f58-90c3-8858e4068773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:37.006459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d06ed2-9aaf-4ea3-a075-cbd2bfdac2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:37.007106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d06ed2-9aaf-4ea3-a075-cbd2bfdac2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:37.007380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d06ed2-9aaf-4ea3-a075-cbd2bfdac2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:37.007651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d06ed2-9aaf-4ea3-a075-cbd2bfdac2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:37.009476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f2d06ed2-9aaf-4ea3-a075-cbd2bfdac2b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:37.046267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 945/1911] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:37.056566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2870e5-8b83-4f58-90c3-8858e4068773 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:37.058114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5c2870e5-8b83-4f58-90c3-8858e4068773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:37.066303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d06ed2-9aaf-4ea3-a075-cbd2bfdac2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:37.067877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d06ed2-9aaf-4ea3-a075-cbd2bfdac2b5 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:37.077016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 967/1912] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:37.112466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2870e5-8b83-4f58-90c3-8858e4068773 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:37.116122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74608aa1-4c13-46b7-8903-bbb719d70693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:37.116765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74608aa1-4c13-46b7-8903-bbb719d70693 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:37.117042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74608aa1-4c13-46b7-8903-bbb719d70693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:37.117314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74608aa1-4c13-46b7-8903-bbb719d70693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:37.126271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74608aa1-4c13-46b7-8903-bbb719d70693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:37.127681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74608aa1-4c13-46b7-8903-bbb719d70693 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:37.137438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 946/1913] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:37.816192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c37a8-0aad-497c-99bf-a07acf95f0a3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:37.816695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c37a8-0aad-497c-99bf-a07acf95f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:37.817828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c37a8-0aad-497c-99bf-a07acf95f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:37.845344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b10c37a8-0aad-497c-99bf-a07acf95f0a3 None None] MFA Rules not processed for user `f6b6567507174da0968f7a022bc06d57`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:37.846578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b10c37a8-0aad-497c-99bf-a07acf95f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:37.909615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 968/1914] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:37.914125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74608aa1-4c13-46b7-8903-bbb719d70693 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:37.923896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74608aa1-4c13-46b7-8903-bbb719d70693 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:37.928686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4c7b7-b8c4-4d11-8f43-451de31c2bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:37.929337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4c7b7-b8c4-4d11-8f43-451de31c2bce admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:37.929618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4c7b7-b8c4-4d11-8f43-451de31c2bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:37.929914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4c7b7-b8c4-4d11-8f43-451de31c2bce admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:37.930596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4c7b7-b8c4-4d11-8f43-451de31c2bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:37.932490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4c7b7-b8c4-4d11-8f43-451de31c2bce admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:37.959114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 947/1915] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:37 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:37.963192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c37a8-0aad-497c-99bf-a07acf95f0a3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:37.974356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c37a8-0aad-497c-99bf-a07acf95f0a3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:38.031492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999fb9f-352f-460d-8288-d3af604b5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:38.032085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999fb9f-352f-460d-8288-d3af604b5c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:38.032365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999fb9f-352f-460d-8288-d3af604b5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:38.032638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999fb9f-352f-460d-8288-d3af604b5c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:38.033331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999fb9f-352f-460d-8288-d3af604b5c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:38.035344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999fb9f-352f-460d-8288-d3af604b5c0f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:38.056683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 969/1916] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:37 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:38.060540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4c7b7-b8c4-4d11-8f43-451de31c2bce admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:38.070804 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4c7b7-b8c4-4d11-8f43-451de31c2bce admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:38.075881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44ef6e-578f-4f21-ad14-0c3fa66e8949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:38.076538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ef6e-578f-4f21-ad14-0c3fa66e8949 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:38.076817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ef6e-578f-4f21-ad14-0c3fa66e8949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:38.077072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ef6e-578f-4f21-ad14-0c3fa66e8949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:38.077823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44ef6e-578f-4f21-ad14-0c3fa66e8949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:38.079409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44ef6e-578f-4f21-ad14-0c3fa66e8949 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:38.090199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 948/1917] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:38.094440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999fb9f-352f-460d-8288-d3af604b5c0f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:38.104486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999fb9f-352f-460d-8288-d3af604b5c0f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:38.109309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371ef5-17f0-43db-b071-e33bd8a440ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:38.110227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371ef5-17f0-43db-b071-e33bd8a440ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:38.110584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371ef5-17f0-43db-b071-e33bd8a440ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:38.110748 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371ef5-17f0-43db-b071-e33bd8a440ea admin admin] PATH_INFO: `/v3/projects/61e5a680f105426893070501a014f6b6/users/f767a7a309494d34892179c00561b244/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:38.129738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5371ef5-17f0-43db-b071-e33bd8a440ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e5a680f105426893070501a014f6b6, user_id=f767a7a309494d34892179c00561b244, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:38.129738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5371ef5-17f0-43db-b071-e33bd8a440ea admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:38.144367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 970/1918] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:38 2022] PUT /identity/v3/projects/61e5a680f105426893070501a014f6b6/users/f767a7a309494d34892179c00561b244/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:38.148860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44ef6e-578f-4f21-ad14-0c3fa66e8949 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:38.160222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44ef6e-578f-4f21-ad14-0c3fa66e8949 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:38.217519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae30ef-58e4-40a8-a762-36721af98297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:38.218221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae30ef-58e4-40a8-a762-36721af98297 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:38.218498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae30ef-58e4-40a8-a762-36721af98297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:38.218767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae30ef-58e4-40a8-a762-36721af98297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:38.219488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae30ef-58e4-40a8-a762-36721af98297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:38.221091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae30ef-58e4-40a8-a762-36721af98297 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:38.230922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 949/1919] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:38.235234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371ef5-17f0-43db-b071-e33bd8a440ea admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:38.246927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371ef5-17f0-43db-b071-e33bd8a440ea admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:38.252026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:38.252906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:38.253184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:38.253460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] PATH_INFO: `/v3/projects/61e5a680f105426893070501a014f6b6/users/f767a7a309494d34892179c00561b244/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:38.255519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e5a680f105426893070501a014f6b6, user_id=f767a7a309494d34892179c00561b244, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:38.258189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:38.268682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 971/1920] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:38 2022] PUT /identity/v3/projects/61e5a680f105426893070501a014f6b6/users/f767a7a309494d34892179c00561b244/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:39.019976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931baa9-73ec-4177-87d2-804fc5dee944 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:39.020956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931baa9-73ec-4177-87d2-804fc5dee944 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:39.021301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931baa9-73ec-4177-87d2-804fc5dee944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:39.047972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0931baa9-73ec-4177-87d2-804fc5dee944 None None] MFA Rules not processed for user `f767a7a309494d34892179c00561b244`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:39.049177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0931baa9-73ec-4177-87d2-804fc5dee944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:39.133828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 950/1921] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:39.761880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:39.763577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:39.830903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc7d63-e254-4747-9296-b06bb45723be admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:39.835436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:39.836332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:39.836611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:39.836879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] PATH_INFO: `/v3/users/9609d145c84942d78097785d941be3b4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:39.838565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9609d145c84942d78097785d941be3b4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:39.840221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:39.888272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9609d145c84942d78097785d941be3b4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:39.901291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9609d145c84942d78097785d941be3b4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:39.902100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9609d145c84942d78097785d941be3b4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:39.908971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9609d145c84942d78097785d941be3b4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:39.916128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9609d145c84942d78097785d941be3b4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:39.922842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 972/1922] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:39 2022] DELETE /identity/v3/users/9609d145c84942d78097785d941be3b4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:39.928618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d70ac-1536-4694-acb1-e48afcf9e197 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:39.928618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d70ac-1536-4694-acb1-e48afcf9e197 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:39.928618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d70ac-1536-4694-acb1-e48afcf9e197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:39.945823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-069d70ac-1536-4694-acb1-e48afcf9e197 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:39.947011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-069d70ac-1536-4694-acb1-e48afcf9e197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:40.014634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 951/1923] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:40.037252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:40.039860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:40.100351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b2d5b-79a9-46d2-915c-461d8ac94e9f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:40.103928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01767c-d912-4c25-941c-b64aa1180bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:40.104573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01767c-d912-4c25-941c-b64aa1180bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:40.104848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01767c-d912-4c25-941c-b64aa1180bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:40.105118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01767c-d912-4c25-941c-b64aa1180bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:40.114499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01767c-d912-4c25-941c-b64aa1180bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:40.116039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01767c-d912-4c25-941c-b64aa1180bb2 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:40.125894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 973/1924] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:40.389401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d70ac-1536-4694-acb1-e48afcf9e197 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:40.391033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-069d70ac-1536-4694-acb1-e48afcf9e197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:40.406196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d70ac-1536-4694-acb1-e48afcf9e197 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:40.412426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:40.413720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:40.414097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:40.414624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] PATH_INFO: `/v3/projects/68b0e9a98f94443692108bd4f128d600` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:40.418786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b0e9a98f94443692108bd4f128d600)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:40.422420 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:40.486763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b0e9a98f94443692108bd4f128d600', 'request_id': 'req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.494985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b0e9a98f94443692108bd4f128d600', 'request_id': 'req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.505085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b0e9a98f94443692108bd4f128d600', 'request_id': 'req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.517318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] The token cache is being invalidate because project 68b0e9a98f94443692108bd4f128d600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:40.517630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.518900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.524156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 952/1925] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:40 2022] DELETE /identity/v3/projects/68b0e9a98f94443692108bd4f128d600 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:40.525655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01767c-d912-4c25-941c-b64aa1180bb2 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:40.535053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01767c-d912-4c25-941c-b64aa1180bb2 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:40.580874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:40.582558 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:40.593645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:40.594557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:40.594834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:40.595106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] PATH_INFO: `/v3/users/416d91103a344a5cba00542c7baf79cc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:40.596641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416d91103a344a5cba00542c7baf79cc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:40.598942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:40.645823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416d91103a344a5cba00542c7baf79cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.648138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6cb5e-c288-4ef2-a9f0-91e2495cd1dd admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:40.656901 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:40.657883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416d91103a344a5cba00542c7baf79cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.658080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:40.658358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:40.658611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416d91103a344a5cba00542c7baf79cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.658721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] PATH_INFO: `/v3/users/f6b6567507174da0968f7a022bc06d57` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:40.660091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b6567507174da0968f7a022bc06d57)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:40.662122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:40.665605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416d91103a344a5cba00542c7baf79cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.674316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416d91103a344a5cba00542c7baf79cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.680537 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 974/1926] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:40 2022] DELETE /identity/v3/users/416d91103a344a5cba00542c7baf79cc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:40.716920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b6567507174da0968f7a022bc06d57'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.730221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b6567507174da0968f7a022bc06d57'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.730926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b6567507174da0968f7a022bc06d57'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.731693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b6567507174da0968f7a022bc06d57'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.738621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b6567507174da0968f7a022bc06d57'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:40.752435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 953/1927] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:40 2022] DELETE /identity/v3/users/f6b6567507174da0968f7a022bc06d57 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:40.928639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:40.930185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:40.965964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:40.967676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:40.995884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446ebd-f4d0-435c-9d7e-5132b63b43f8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:41.032543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc83ab3-ec4a-420a-ab5e-67e290e5e072 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:41.037347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:41.038349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:41.038622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:41.039183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] PATH_INFO: `/v3/projects/d73e9655a2ce4b6dacf1ba2248f85bb4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:41.040366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73e9655a2ce4b6dacf1ba2248f85bb4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:41.042393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:41.050802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:41.051706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:41.051986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:41.052260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] PATH_INFO: `/v3/projects/41d2d86a107d4a85b93b469cf4d09910` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:41.053436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d2d86a107d4a85b93b469cf4d09910)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:41.055690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:41.097515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73e9655a2ce4b6dacf1ba2248f85bb4', 'request_id': 'req-e965de9e-131c-4a91-b292-b1ea5d458673'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.104162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73e9655a2ce4b6dacf1ba2248f85bb4', 'request_id': 'req-e965de9e-131c-4a91-b292-b1ea5d458673'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.113040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73e9655a2ce4b6dacf1ba2248f85bb4', 'request_id': 'req-e965de9e-131c-4a91-b292-b1ea5d458673'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.117226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d2d86a107d4a85b93b469cf4d09910', 'request_id': 'req-cbce8a22-5963-4a5a-9e58-69d6de97bce1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.123650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d2d86a107d4a85b93b469cf4d09910', 'request_id': 'req-cbce8a22-5963-4a5a-9e58-69d6de97bce1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.124919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] The token cache is being invalidate because project d73e9655a2ce4b6dacf1ba2248f85bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:41.125207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.125849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.127474 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 954/1928] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:40 2022] DELETE /identity/v3/projects/d73e9655a2ce4b6dacf1ba2248f85bb4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:41.131648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:41.133305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:41.134910 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d2d86a107d4a85b93b469cf4d09910', 'request_id': 'req-cbce8a22-5963-4a5a-9e58-69d6de97bce1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.146492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] The token cache is being invalidate because project 41d2d86a107d4a85b93b469cf4d09910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:41.147152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.148295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.150105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 975/1929] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:40 2022] DELETE /identity/v3/projects/41d2d86a107d4a85b93b469cf4d09910 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:41.153680 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:41.155264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:41.216991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965de9e-131c-4a91-b292-b1ea5d458673 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:41.222205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce8a22-5963-4a5a-9e58-69d6de97bce1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:41.222921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:41.223948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:41.224279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:41.224586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] PATH_INFO: `/v3/users/54ce7c8587e4448cb44345ec77d59a92` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:41.226032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ce7c8587e4448cb44345ec77d59a92)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:41.227395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:41.228165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:41.228420 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:41.228766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:41.229102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] PATH_INFO: `/v3/users/f767a7a309494d34892179c00561b244` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:41.230728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f767a7a309494d34892179c00561b244)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:41.232430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:41.278669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ce7c8587e4448cb44345ec77d59a92'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.286468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f767a7a309494d34892179c00561b244'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.290170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ce7c8587e4448cb44345ec77d59a92'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.290876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ce7c8587e4448cb44345ec77d59a92'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.291485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ce7c8587e4448cb44345ec77d59a92'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.299733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f767a7a309494d34892179c00561b244'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.302920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f767a7a309494d34892179c00561b244'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.314215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ce7c8587e4448cb44345ec77d59a92'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.314387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f767a7a309494d34892179c00561b244'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.318289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f767a7a309494d34892179c00561b244'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.321037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 955/1930] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:41 2022] DELETE /identity/v3/users/54ce7c8587e4448cb44345ec77d59a92 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:41.324515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 976/1931] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:41 2022] DELETE /identity/v3/users/f767a7a309494d34892179c00561b244 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:41.561984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:41.564083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:41.655742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5283b-2bbc-4314-8c46-50d2926d79e3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:41.720013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:41.721650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:41.754764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:41.756130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:41.756653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:41.757091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] PATH_INFO: `/v3/projects/61e5a680f105426893070501a014f6b6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:41.758520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e5a680f105426893070501a014f6b6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:41.760572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:41.829997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e5a680f105426893070501a014f6b6', 'request_id': 'req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.836638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e5a680f105426893070501a014f6b6', 'request_id': 'req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.837357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902695e4-d8ee-43f3-9b7e-0310f9b445e1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:41.849865 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e5a680f105426893070501a014f6b6', 'request_id': 'req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.878871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] The token cache is being invalidate because project 61e5a680f105426893070501a014f6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:41.879619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.886969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86e5a0d1-f0ad-49a8-af4d-939cebc4e38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:41.889454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 956/1932] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:41 2022] DELETE /identity/v3/projects/61e5a680f105426893070501a014f6b6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:41.895471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e1fb-eb7b-4945-b194-ee43db469d9b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:41.895852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e1fb-eb7b-4945-b194-ee43db469d9b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:41.896198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e1fb-eb7b-4945-b194-ee43db469d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:41.929460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:41.931484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4af2e1fb-eb7b-4945-b194-ee43db469d9b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:41.931979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:41.932545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:41.933618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4af2e1fb-eb7b-4945-b194-ee43db469d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:41.933789 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] PATH_INFO: `/v3/projects/662cff4e79f44fddb92a3bd9336eb513` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:41.938551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] RBAC: Authorizing `identity:delete_project(project_id=662cff4e79f44fddb92a3bd9336eb513)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:41.948258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 957/1933] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:41.949096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656cb7-5f07-4339-b264-893be373830f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:41.949532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656cb7-5f07-4339-b264-893be373830f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:41.949737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656cb7-5f07-4339-b264-893be373830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:41.950716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:41.982065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a4656cb7-5f07-4339-b264-893be373830f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:41.983952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a4656cb7-5f07-4339-b264-893be373830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:41.995017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 958/1934] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:41.998798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4656cb7-5f07-4339-b264-893be373830f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.012393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4656cb7-5f07-4339-b264-893be373830f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.027638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662cff4e79f44fddb92a3bd9336eb513', 'request_id': 'req-ec818897-d8b1-4e24-87fc-a13bdda3592a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:42.037315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662cff4e79f44fddb92a3bd9336eb513', 'request_id': 'req-ec818897-d8b1-4e24-87fc-a13bdda3592a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:42.046046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662cff4e79f44fddb92a3bd9336eb513', 'request_id': 'req-ec818897-d8b1-4e24-87fc-a13bdda3592a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:42.060375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] The token cache is being invalidate because project 662cff4e79f44fddb92a3bd9336eb513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:42.060755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:42.061731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ec818897-d8b1-4e24-87fc-a13bdda3592a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:42.069030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 977/1935] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:41 2022] DELETE /identity/v3/projects/662cff4e79f44fddb92a3bd9336eb513 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:42.072571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe18d8-af17-4572-9997-28fc1b65808b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.072953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe18d8-af17-4572-9997-28fc1b65808b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.073323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe18d8-af17-4572-9997-28fc1b65808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.094067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8cfe18d8-af17-4572-9997-28fc1b65808b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:42.095521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8cfe18d8-af17-4572-9997-28fc1b65808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:42.103337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.104046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.104326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.104599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.105453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:42.105792 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.107397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.125606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 959/1936] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:42.127117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.131833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:42.150143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00543dae-773c-45f8-a31b-7d0a9c782cd8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.163777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c9462-1cab-4171-b665-df8ef8ab26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.164457 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9462-1cab-4171-b665-df8ef8ab26dc admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.164733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9462-1cab-4171-b665-df8ef8ab26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.165009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9462-1cab-4171-b665-df8ef8ab26dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.165714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9462-1cab-4171-b665-df8ef8ab26dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.168376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9462-1cab-4171-b665-df8ef8ab26dc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.197246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 978/1937] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:42.206907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6a4e3-4eb8-4916-87df-9ef09ab5250d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.207416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6a4e3-4eb8-4916-87df-9ef09ab5250d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.209962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6a4e3-4eb8-4916-87df-9ef09ab5250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.219223 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 960/1938] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:42.224729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c9462-1cab-4171-b665-df8ef8ab26dc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.231720 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2db6a4e3-4eb8-4916-87df-9ef09ab5250d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:42.233178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2db6a4e3-4eb8-4916-87df-9ef09ab5250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:42.305924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c9462-1cab-4171-b665-df8ef8ab26dc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.310902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab949f14-9c3d-4cbe-a437-15fb92206b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.312011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949f14-9c3d-4cbe-a437-15fb92206b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.312436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949f14-9c3d-4cbe-a437-15fb92206b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.312950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949f14-9c3d-4cbe-a437-15fb92206b15 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.314317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab949f14-9c3d-4cbe-a437-15fb92206b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.316407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab949f14-9c3d-4cbe-a437-15fb92206b15 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.346983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 979/1939] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:42.348301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6a4e3-4eb8-4916-87df-9ef09ab5250d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.358050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 961/1940] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:42.361986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab949f14-9c3d-4cbe-a437-15fb92206b15 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.365422 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6a4e3-4eb8-4916-87df-9ef09ab5250d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.374392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab949f14-9c3d-4cbe-a437-15fb92206b15 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.380053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410544bc-1383-4a83-9890-3334bb58ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.380747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410544bc-1383-4a83-9890-3334bb58ef07 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.381025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410544bc-1383-4a83-9890-3334bb58ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.381287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.381411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410544bc-1383-4a83-9890-3334bb58ef07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.382149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410544bc-1383-4a83-9890-3334bb58ef07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.382284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.382652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.383025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.383765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410544bc-1383-4a83-9890-3334bb58ef07 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.383878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:42.384280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.389178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.396192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 962/1941] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:42.400113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410544bc-1383-4a83-9890-3334bb58ef07 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.418815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410544bc-1383-4a83-9890-3334bb58ef07 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.425114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063950f9-bc0b-45c3-a920-cb97b36a0a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.429316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063950f9-bc0b-45c3-a920-cb97b36a0a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.429996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063950f9-bc0b-45c3-a920-cb97b36a0a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.430294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063950f9-bc0b-45c3-a920-cb97b36a0a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.431119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063950f9-bc0b-45c3-a920-cb97b36a0a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.432964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063950f9-bc0b-45c3-a920-cb97b36a0a6f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.433778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 980/1942] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:42.434726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.445288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 963/1943] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:42.449429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063950f9-bc0b-45c3-a920-cb97b36a0a6f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.458319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3bfa-3af4-4564-8353-46ab70028a8f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.459798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063950f9-bc0b-45c3-a920-cb97b36a0a6f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.463355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b57da3-d450-4e93-9313-03ac4d32aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.464029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57da3-d450-4e93-9313-03ac4d32aec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.464400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57da3-d450-4e93-9313-03ac4d32aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.464682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57da3-d450-4e93-9313-03ac4d32aec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.465068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e12f-c653-4a0a-a6d3-bea85b3edbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.465426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b57da3-d450-4e93-9313-03ac4d32aec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.466056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e12f-c653-4a0a-a6d3-bea85b3edbb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.466406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e12f-c653-4a0a-a6d3-bea85b3edbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.466680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e12f-c653-4a0a-a6d3-bea85b3edbb1 admin admin] PATH_INFO: `/v3/projects/6c489133bd254260826fc72d8d885633/users/7585cf2746014429a8c2b2adf7858eeb/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.467388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b57da3-d450-4e93-9313-03ac4d32aec9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.486499 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5e12f-c653-4a0a-a6d3-bea85b3edbb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c489133bd254260826fc72d8d885633, user_id=7585cf2746014429a8c2b2adf7858eeb, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.489541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5e12f-c653-4a0a-a6d3-bea85b3edbb1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.509053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 964/1944] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:42 2022] PUT /identity/v3/projects/6c489133bd254260826fc72d8d885633/users/7585cf2746014429a8c2b2adf7858eeb/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:42.513730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 981/1945] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:42.515339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b57da3-d450-4e93-9313-03ac4d32aec9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.520422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e496d-9a6f-4d81-8676-82b60f002fea None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.521004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e496d-9a6f-4d81-8676-82b60f002fea None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.521494 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e496d-9a6f-4d81-8676-82b60f002fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.551948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-090e496d-9a6f-4d81-8676-82b60f002fea None None] MFA Rules not processed for user `7585cf2746014429a8c2b2adf7858eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:42.553362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-090e496d-9a6f-4d81-8676-82b60f002fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:42.611503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b57da3-d450-4e93-9313-03ac4d32aec9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.621657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a480d-7757-4856-8866-9c1070111332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.622927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a480d-7757-4856-8866-9c1070111332 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.623312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a480d-7757-4856-8866-9c1070111332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.623691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a480d-7757-4856-8866-9c1070111332 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.624983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a480d-7757-4856-8866-9c1070111332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.628280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a480d-7757-4856-8866-9c1070111332 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.662977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 965/1946] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:42.666563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 982/1947] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:42.667947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e496d-9a6f-4d81-8676-82b60f002fea None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.671123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a480d-7757-4856-8866-9c1070111332 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.683995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a480d-7757-4856-8866-9c1070111332 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.684747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e496d-9a6f-4d81-8676-82b60f002fea None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.690328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a648af-7fa3-44c9-ae63-4455717ed954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.690767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd37d5-95a8-408c-b32f-8b53e30d6d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.691444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd37d5-95a8-408c-b32f-8b53e30d6d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.691616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a648af-7fa3-44c9-ae63-4455717ed954 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.691778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd37d5-95a8-408c-b32f-8b53e30d6d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.691874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a648af-7fa3-44c9-ae63-4455717ed954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.692048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd37d5-95a8-408c-b32f-8b53e30d6d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.692141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a648af-7fa3-44c9-ae63-4455717ed954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.692797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd37d5-95a8-408c-b32f-8b53e30d6d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.692911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a648af-7fa3-44c9-ae63-4455717ed954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.694473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a648af-7fa3-44c9-ae63-4455717ed954 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.694925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd37d5-95a8-408c-b32f-8b53e30d6d59 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.705617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 983/1948] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:42.709260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a648af-7fa3-44c9-ae63-4455717ed954 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.719370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a648af-7fa3-44c9-ae63-4455717ed954 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.724820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8db2ec-40fb-4d03-b8d2-4e94a8d0d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.725671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8db2ec-40fb-4d03-b8d2-4e94a8d0d291 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.725954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8db2ec-40fb-4d03-b8d2-4e94a8d0d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.726227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8db2ec-40fb-4d03-b8d2-4e94a8d0d291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.726950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8db2ec-40fb-4d03-b8d2-4e94a8d0d291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.728551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8db2ec-40fb-4d03-b8d2-4e94a8d0d291 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.730014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 966/1949] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:42.733841 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd37d5-95a8-408c-b32f-8b53e30d6d59 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.743653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 984/1950] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:42.747324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8db2ec-40fb-4d03-b8d2-4e94a8d0d291 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.758541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8db2ec-40fb-4d03-b8d2-4e94a8d0d291 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.803397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd37d5-95a8-408c-b32f-8b53e30d6d59 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.808679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc79b5-db66-44c8-80ef-cc852bf6cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.809707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc79b5-db66-44c8-80ef-cc852bf6cd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.809707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc79b5-db66-44c8-80ef-cc852bf6cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.809909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc79b5-db66-44c8-80ef-cc852bf6cd04 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.810602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc79b5-db66-44c8-80ef-cc852bf6cd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.812886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc79b5-db66-44c8-80ef-cc852bf6cd04 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.827906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc302fb-e164-4b51-9aa5-95c113dcfe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.829304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc302fb-e164-4b51-9aa5-95c113dcfe1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.829785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc302fb-e164-4b51-9aa5-95c113dcfe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.830165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc302fb-e164-4b51-9aa5-95c113dcfe1b admin admin] PATH_INFO: `/v3/projects/8f315555ce5943738be4b5b328c93e1a/users/ff5789a983644d90a11ea3cfc637b88b/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.849385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc302fb-e164-4b51-9aa5-95c113dcfe1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f315555ce5943738be4b5b328c93e1a, user_id=ff5789a983644d90a11ea3cfc637b88b, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.853854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc302fb-e164-4b51-9aa5-95c113dcfe1b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.859381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 967/1951] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:42.861266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc79b5-db66-44c8-80ef-cc852bf6cd04 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.875490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc79b5-db66-44c8-80ef-cc852bf6cd04 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.879466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 985/1952] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:42 2022] PUT /identity/v3/projects/8f315555ce5943738be4b5b328c93e1a/users/ff5789a983644d90a11ea3cfc637b88b/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:42.891130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345a90-8f91-4567-999a-6c0ea1ccdbb7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.891417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345a90-8f91-4567-999a-6c0ea1ccdbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.891861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345a90-8f91-4567-999a-6c0ea1ccdbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.918477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4b345a90-8f91-4567-999a-6c0ea1ccdbb7 None None] MFA Rules not processed for user `ff5789a983644d90a11ea3cfc637b88b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:42.919669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4b345a90-8f91-4567-999a-6c0ea1ccdbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:42.937409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c906-a03a-4aa2-a5f6-5c65d2311148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.938226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c906-a03a-4aa2-a5f6-5c65d2311148 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.938600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c906-a03a-4aa2-a5f6-5c65d2311148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.938970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c906-a03a-4aa2-a5f6-5c65d2311148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:42.940083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c906-a03a-4aa2-a5f6-5c65d2311148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:42.941882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c906-a03a-4aa2-a5f6-5c65d2311148 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:42.954593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 968/1953] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:42.958976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c906-a03a-4aa2-a5f6-5c65d2311148 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:42.972788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c906-a03a-4aa2-a5f6-5c65d2311148 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:42.978897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173f823-73bc-4dd1-bba2-c3882ef41438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:42.980424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173f823-73bc-4dd1-bba2-c3882ef41438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:42.981662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173f823-73bc-4dd1-bba2-c3882ef41438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:42.982013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173f823-73bc-4dd1-bba2-c3882ef41438 admin admin] PATH_INFO: `/v3/projects/ec9ed82fe4294606b826d0284f19a904/users/48b5184f8af648de9e2843ec6eb9d6b1/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.003014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 986/1954] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:43.007340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b345a90-8f91-4567-999a-6c0ea1ccdbb7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.007827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173f823-73bc-4dd1-bba2-c3882ef41438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9ed82fe4294606b826d0284f19a904, user_id=48b5184f8af648de9e2843ec6eb9d6b1, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.010627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173f823-73bc-4dd1-bba2-c3882ef41438 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.019226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b345a90-8f91-4567-999a-6c0ea1ccdbb7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.025384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 969/1955] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:42 2022] PUT /identity/v3/projects/ec9ed82fe4294606b826d0284f19a904/users/48b5184f8af648de9e2843ec6eb9d6b1/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:43.029196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173f823-73bc-4dd1-bba2-c3882ef41438 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.073358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f0733-bfcf-4781-aeba-177827692396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.074197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f0733-bfcf-4781-aeba-177827692396 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.074478 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f0733-bfcf-4781-aeba-177827692396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.074754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f0733-bfcf-4781-aeba-177827692396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.075444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f0733-bfcf-4781-aeba-177827692396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.077361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f0733-bfcf-4781-aeba-177827692396 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.088103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173f823-73bc-4dd1-bba2-c3882ef41438 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.092924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503596-4721-4d6b-9efc-5e9a72782173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.093572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503596-4721-4d6b-9efc-5e9a72782173 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.093925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503596-4721-4d6b-9efc-5e9a72782173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.094209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503596-4721-4d6b-9efc-5e9a72782173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.095014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3503596-4721-4d6b-9efc-5e9a72782173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.096608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3503596-4721-4d6b-9efc-5e9a72782173 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.103692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 987/1956] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:43 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:43.106593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 970/1957] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:43.110483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503596-4721-4d6b-9efc-5e9a72782173 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.110596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f0733-bfcf-4781-aeba-177827692396 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.120379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503596-4721-4d6b-9efc-5e9a72782173 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.169581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f0733-bfcf-4781-aeba-177827692396 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.175302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781f8e0-6a0a-4ad7-82c0-31939537a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.176002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781f8e0-6a0a-4ad7-82c0-31939537a73e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.176279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781f8e0-6a0a-4ad7-82c0-31939537a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.176548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781f8e0-6a0a-4ad7-82c0-31939537a73e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.177234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781f8e0-6a0a-4ad7-82c0-31939537a73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.178674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ed725-be7c-45c8-8c82-3b264b7140d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.179282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781f8e0-6a0a-4ad7-82c0-31939537a73e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.179566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed725-be7c-45c8-8c82-3b264b7140d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.179846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed725-be7c-45c8-8c82-3b264b7140d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.180117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed725-be7c-45c8-8c82-3b264b7140d5 admin admin] PATH_INFO: `/v3/projects/ec9ed82fe4294606b826d0284f19a904/users/48b5184f8af648de9e2843ec6eb9d6b1/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.182157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ed725-be7c-45c8-8c82-3b264b7140d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9ed82fe4294606b826d0284f19a904, user_id=48b5184f8af648de9e2843ec6eb9d6b1, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.184786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ed725-be7c-45c8-8c82-3b264b7140d5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.195074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 971/1958] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:43 2022] PUT /identity/v3/projects/ec9ed82fe4294606b826d0284f19a904/users/48b5184f8af648de9e2843ec6eb9d6b1/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:43.200170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 988/1959] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:43 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:43.207500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ed725-be7c-45c8-8c82-3b264b7140d5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.207919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50724997-ccba-4006-8819-adebc769f1f9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.208207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50724997-ccba-4006-8819-adebc769f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.208482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50724997-ccba-4006-8819-adebc769f1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.235518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-50724997-ccba-4006-8819-adebc769f1f9 None None] MFA Rules not processed for user `48b5184f8af648de9e2843ec6eb9d6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:43.236630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-50724997-ccba-4006-8819-adebc769f1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:43.267452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ed725-be7c-45c8-8c82-3b264b7140d5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.272209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e75cd1-4fd3-48e3-a797-202493bb783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.272873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e75cd1-4fd3-48e3-a797-202493bb783f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.273150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e75cd1-4fd3-48e3-a797-202493bb783f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.273421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e75cd1-4fd3-48e3-a797-202493bb783f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.274171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e75cd1-4fd3-48e3-a797-202493bb783f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.275781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e75cd1-4fd3-48e3-a797-202493bb783f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.285407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 972/1960] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:43.289502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e75cd1-4fd3-48e3-a797-202493bb783f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.299005 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e75cd1-4fd3-48e3-a797-202493bb783f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.304080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a524d-540b-4f4b-8312-260f694eb699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.304578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 989/1961] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:43.305145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a524d-540b-4f4b-8312-260f694eb699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.305486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a524d-540b-4f4b-8312-260f694eb699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.305911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a524d-540b-4f4b-8312-260f694eb699 admin admin] PATH_INFO: `/v3/projects/0ed26d09b76b4e94be35b0412aa9a902/users/cb43784fbf334ffa9b8d86d2c776eab8/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.315698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50724997-ccba-4006-8819-adebc769f1f9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.317154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-50724997-ccba-4006-8819-adebc769f1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:43.321476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a524d-540b-4f4b-8312-260f694eb699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed26d09b76b4e94be35b0412aa9a902, user_id=cb43784fbf334ffa9b8d86d2c776eab8, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.330488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a524d-540b-4f4b-8312-260f694eb699 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.348040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 973/1962] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:43 2022] PUT /identity/v3/projects/0ed26d09b76b4e94be35b0412aa9a902/users/cb43784fbf334ffa9b8d86d2c776eab8/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:43.352087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a524d-540b-4f4b-8312-260f694eb699 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.373188 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50724997-ccba-4006-8819-adebc769f1f9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.409910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a524d-540b-4f4b-8312-260f694eb699 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.414606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7a0c6-7689-4ac3-a56b-a2dc44272573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.415268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7a0c6-7689-4ac3-a56b-a2dc44272573 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.415562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7a0c6-7689-4ac3-a56b-a2dc44272573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.415852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7a0c6-7689-4ac3-a56b-a2dc44272573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.416556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7a0c6-7689-4ac3-a56b-a2dc44272573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.418191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7a0c6-7689-4ac3-a56b-a2dc44272573 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.421711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1cc23-63da-4431-aefb-43a97a4d1598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.422369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1cc23-63da-4431-aefb-43a97a4d1598 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.422650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1cc23-63da-4431-aefb-43a97a4d1598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.422921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1cc23-63da-4431-aefb-43a97a4d1598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.428697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 974/1963] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:43.433136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7a0c6-7689-4ac3-a56b-a2dc44272573 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.442980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7a0c6-7689-4ac3-a56b-a2dc44272573 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.447621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31f35f-259e-40ae-8877-218c69d52845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.448474 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f35f-259e-40ae-8877-218c69d52845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.448737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f35f-259e-40ae-8877-218c69d52845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.449005 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f35f-259e-40ae-8877-218c69d52845 admin admin] PATH_INFO: `/v3/projects/0ed26d09b76b4e94be35b0412aa9a902/users/cb43784fbf334ffa9b8d86d2c776eab8/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.451050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31f35f-259e-40ae-8877-218c69d52845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed26d09b76b4e94be35b0412aa9a902, user_id=cb43784fbf334ffa9b8d86d2c776eab8, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.453746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31f35f-259e-40ae-8877-218c69d52845 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.463725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 975/1964] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:43 2022] PUT /identity/v3/projects/0ed26d09b76b4e94be35b0412aa9a902/users/cb43784fbf334ffa9b8d86d2c776eab8/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:43.474759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b89cf4-036b-43c8-9566-19e126fbc057 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.475045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b89cf4-036b-43c8-9566-19e126fbc057 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.475318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b89cf4-036b-43c8-9566-19e126fbc057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.483437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1cc23-63da-4431-aefb-43a97a4d1598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.484885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1cc23-63da-4431-aefb-43a97a4d1598 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.494627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 990/1965] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:43.500876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-00b89cf4-036b-43c8-9566-19e126fbc057 None None] MFA Rules not processed for user `cb43784fbf334ffa9b8d86d2c776eab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:43.502097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-00b89cf4-036b-43c8-9566-19e126fbc057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:43.576267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 976/1966] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:43.586728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1cc23-63da-4431-aefb-43a97a4d1598 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.595186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1cc23-63da-4431-aefb-43a97a4d1598 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.651433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b458c56-035d-4c64-a602-9c0335dc71bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.652092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458c56-035d-4c64-a602-9c0335dc71bf service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.652366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458c56-035d-4c64-a602-9c0335dc71bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.652640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458c56-035d-4c64-a602-9c0335dc71bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.662342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b458c56-035d-4c64-a602-9c0335dc71bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.663781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b458c56-035d-4c64-a602-9c0335dc71bf service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.679192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 991/1967] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:43.725058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b89cf4-036b-43c8-9566-19e126fbc057 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:43.738224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b89cf4-036b-43c8-9566-19e126fbc057 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:43.742100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14448440-e576-4c84-8f8e-9c81b36b197b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:43.742735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448440-e576-4c84-8f8e-9c81b36b197b service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:43.743008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448440-e576-4c84-8f8e-9c81b36b197b service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:43.743274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448440-e576-4c84-8f8e-9c81b36b197b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:43.810750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14448440-e576-4c84-8f8e-9c81b36b197b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:43.812106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14448440-e576-4c84-8f8e-9c81b36b197b service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:43.821429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 977/1968] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:44.546669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b458c56-035d-4c64-a602-9c0335dc71bf service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:44.609599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b458c56-035d-4c64-a602-9c0335dc71bf service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:44.615645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:44.616828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:44.617112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:44.617379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] PATH_INFO: `/v3/users/ff5789a983644d90a11ea3cfc637b88b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:44.618701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5789a983644d90a11ea3cfc637b88b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:44.620724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:44.667676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5789a983644d90a11ea3cfc637b88b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:44.680700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5789a983644d90a11ea3cfc637b88b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:44.681492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5789a983644d90a11ea3cfc637b88b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:44.689294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5789a983644d90a11ea3cfc637b88b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:44.699042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5789a983644d90a11ea3cfc637b88b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:44.705449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 992/1969] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:44 2022] DELETE /identity/v3/users/ff5789a983644d90a11ea3cfc637b88b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:44.711514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f876f6-90cc-4d6f-bfb5-5b357b29039a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:44.711827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f876f6-90cc-4d6f-bfb5-5b357b29039a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:44.712099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f876f6-90cc-4d6f-bfb5-5b357b29039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:44.730626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-20f876f6-90cc-4d6f-bfb5-5b357b29039a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:44.731819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-20f876f6-90cc-4d6f-bfb5-5b357b29039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:44.792296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 978/1970] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:44.802534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:44.804216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:44.859368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1100f11-c7a3-4ac0-9e32-28c87d8239bc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:44.863438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:44.864074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:44.864343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:44.864606 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:44.874329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:44.875811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:44.886104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 993/1971] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:45.147801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f876f6-90cc-4d6f-bfb5-5b357b29039a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:45.156118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-20f876f6-90cc-4d6f-bfb5-5b357b29039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:45.248805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f876f6-90cc-4d6f-bfb5-5b357b29039a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:45.254382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:45.254382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:45.254382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:45.254382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:45.258842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:45.342614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:45.344255 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:45.355835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 979/1972] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:45.388186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:45.389582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:45.405652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc7c1d-86d4-4769-ae54-e4fc1f6c4a30 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:45.418770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:45.419623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:45.420045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:45.423008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] PATH_INFO: `/v3/projects/8f315555ce5943738be4b5b328c93e1a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:45.426440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f315555ce5943738be4b5b328c93e1a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:45.433106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:45.517625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f315555ce5943738be4b5b328c93e1a', 'request_id': 'req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.525319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f315555ce5943738be4b5b328c93e1a', 'request_id': 'req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.537401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f315555ce5943738be4b5b328c93e1a', 'request_id': 'req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.556867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] The token cache is being invalidate because project 8f315555ce5943738be4b5b328c93e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:45.567388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.568888 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.571434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 994/1973] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:45 2022] DELETE /identity/v3/projects/8f315555ce5943738be4b5b328c93e1a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:45.575712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:45.590942 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781f84-780e-4699-bf78-ee7451689ec5 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:45.678297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:45.679452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:45.679916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:45.680250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] PATH_INFO: `/v3/users/cb43784fbf334ffa9b8d86d2c776eab8` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:45.681632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb43784fbf334ffa9b8d86d2c776eab8)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:45.683609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:45.742251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb43784fbf334ffa9b8d86d2c776eab8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.765165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb43784fbf334ffa9b8d86d2c776eab8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.766204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb43784fbf334ffa9b8d86d2c776eab8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.767064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb43784fbf334ffa9b8d86d2c776eab8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.778933 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ad44ea7e-f4b0-4cfa-a45a-f40df5386c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb43784fbf334ffa9b8d86d2c776eab8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:45.823392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 980/1974] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:45 2022] DELETE /identity/v3/users/cb43784fbf334ffa9b8d86d2c776eab8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:46.553375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:46.555050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:46.573369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270d00-05b8-4eaa-b5ae-ebe27d8bf0c7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:46.640592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:46.641686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:46.642210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:46.642748 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] PATH_INFO: `/v3/projects/0ed26d09b76b4e94be35b0412aa9a902` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:46.644642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed26d09b76b4e94be35b0412aa9a902)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:46.648024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:46.701911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed26d09b76b4e94be35b0412aa9a902', 'request_id': 'req-5aa7cff4-e6dd-4085-8420-22b714c21bba'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:46.709031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed26d09b76b4e94be35b0412aa9a902', 'request_id': 'req-5aa7cff4-e6dd-4085-8420-22b714c21bba'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:46.721973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed26d09b76b4e94be35b0412aa9a902', 'request_id': 'req-5aa7cff4-e6dd-4085-8420-22b714c21bba'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:46.739064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] The token cache is being invalidate because project 0ed26d09b76b4e94be35b0412aa9a902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:46.739353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:46.740009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5aa7cff4-e6dd-4085-8420-22b714c21bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:46.741786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 995/1975] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:46 2022] DELETE /identity/v3/projects/0ed26d09b76b4e94be35b0412aa9a902 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:46.746699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0fbb4-6a3a-4f99-8f06-336b9563355b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:46.747191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0fbb4-6a3a-4f99-8f06-336b9563355b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:46.747688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0fbb4-6a3a-4f99-8f06-336b9563355b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:46.766504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8eb0fbb4-6a3a-4f99-8f06-336b9563355b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:46.767926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8eb0fbb4-6a3a-4f99-8f06-336b9563355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:46.841696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 981/1976] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:46.849605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726bd86-d87c-49ea-b0fe-d66fd9babeba None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:46.850185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726bd86-d87c-49ea-b0fe-d66fd9babeba None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:46.850627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726bd86-d87c-49ea-b0fe-d66fd9babeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:46.872982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e726bd86-d87c-49ea-b0fe-d66fd9babeba None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:46.874380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e726bd86-d87c-49ea-b0fe-d66fd9babeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:46.883109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 996/1977] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:46.887193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0fbb4-6a3a-4f99-8f06-336b9563355b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:46.899255 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0fbb4-6a3a-4f99-8f06-336b9563355b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:46.902533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:46.903271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:46.903622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:46.904098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:46.904903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:46.905283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:46.907055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:46.921063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 982/1978] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:46.925059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726bd86-d87c-49ea-b0fe-d66fd9babeba None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:46.935138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726bd86-d87c-49ea-b0fe-d66fd9babeba None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:46.940185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37ba0a-6ea8-4a3b-9169-4d44a73682f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:46.941214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ba0a-6ea8-4a3b-9169-4d44a73682f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:46.941838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ba0a-6ea8-4a3b-9169-4d44a73682f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:46.942167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ba0a-6ea8-4a3b-9169-4d44a73682f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:46.942858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37ba0a-6ea8-4a3b-9169-4d44a73682f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:46.944774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37ba0a-6ea8-4a3b-9169-4d44a73682f0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:46.977967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:46.979327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 997/1979] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:46 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:46.987973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbbc72-c7f0-4b04-af25-10c05bbf916e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.048348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91461-9b27-4680-830e-04f6f3a87e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.049165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91461-9b27-4680-830e-04f6f3a87e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.049331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91461-9b27-4680-830e-04f6f3a87e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.049615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91461-9b27-4680-830e-04f6f3a87e0f admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.050308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e91461-9b27-4680-830e-04f6f3a87e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.052534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e91461-9b27-4680-830e-04f6f3a87e0f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.078201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 983/1980] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:46 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:47.078431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37ba0a-6ea8-4a3b-9169-4d44a73682f0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.089075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37ba0a-6ea8-4a3b-9169-4d44a73682f0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.093836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc83cd-c63e-4afc-9b4e-489c800c398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.094517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc83cd-c63e-4afc-9b4e-489c800c398c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.094793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc83cd-c63e-4afc-9b4e-489c800c398c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.095058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc83cd-c63e-4afc-9b4e-489c800c398c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.095787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc83cd-c63e-4afc-9b4e-489c800c398c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.097637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc83cd-c63e-4afc-9b4e-489c800c398c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.120633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91461-9b27-4680-830e-04f6f3a87e0f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.121357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 998/1981] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:47.133357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91461-9b27-4680-830e-04f6f3a87e0f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.138408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7efa0-5f3b-419d-9f95-0a61db1bc274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.139086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7efa0-5f3b-419d-9f95-0a61db1bc274 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.139357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7efa0-5f3b-419d-9f95-0a61db1bc274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.139722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7efa0-5f3b-419d-9f95-0a61db1bc274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.140391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7efa0-5f3b-419d-9f95-0a61db1bc274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.142031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7efa0-5f3b-419d-9f95-0a61db1bc274 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.153353 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 984/1982] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:47.157407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc83cd-c63e-4afc-9b4e-489c800c398c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.167639 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc83cd-c63e-4afc-9b4e-489c800c398c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.174510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0136a7-2e12-4e01-9c8d-5272ca5fccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.176019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0136a7-2e12-4e01-9c8d-5272ca5fccc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.176293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0136a7-2e12-4e01-9c8d-5272ca5fccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.176561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0136a7-2e12-4e01-9c8d-5272ca5fccc2 admin admin] PATH_INFO: `/v3/projects/5a3b99eca5084f58a36b82955a37f906/users/29ccb66a59694fce9986ab4c8e31075b/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.195211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0136a7-2e12-4e01-9c8d-5272ca5fccc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3b99eca5084f58a36b82955a37f906, user_id=29ccb66a59694fce9986ab4c8e31075b, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.197911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0136a7-2e12-4e01-9c8d-5272ca5fccc2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.217784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 999/1983] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:47 2022] PUT /identity/v3/projects/5a3b99eca5084f58a36b82955a37f906/users/29ccb66a59694fce9986ab4c8e31075b/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:47.228505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cd587-d182-410c-beea-c6058dc01daf None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.228852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cd587-d182-410c-beea-c6058dc01daf None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.229132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cd587-d182-410c-beea-c6058dc01daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.259007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8a9cd587-d182-410c-beea-c6058dc01daf None None] MFA Rules not processed for user `29ccb66a59694fce9986ab4c8e31075b`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:47.260198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8a9cd587-d182-410c-beea-c6058dc01daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:47.323459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 985/1984] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:47.328050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0136a7-2e12-4e01-9c8d-5272ca5fccc2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.394098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0136a7-2e12-4e01-9c8d-5272ca5fccc2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.395234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11a55-234a-4021-ad0c-d1fb07ae46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.395898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11a55-234a-4021-ad0c-d1fb07ae46a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.396175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11a55-234a-4021-ad0c-d1fb07ae46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.396429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11a55-234a-4021-ad0c-d1fb07ae46a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.397118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea11a55-234a-4021-ad0c-d1fb07ae46a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.399044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea11a55-234a-4021-ad0c-d1fb07ae46a5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.426132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1000/1985] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:47 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:47.430300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cd587-d182-410c-beea-c6058dc01daf None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.441488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cd587-d182-410c-beea-c6058dc01daf None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.499771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a2d21-ca6f-4928-9bd1-8dacdc396a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.500449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2d21-ca6f-4928-9bd1-8dacdc396a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.500706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2d21-ca6f-4928-9bd1-8dacdc396a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.500978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2d21-ca6f-4928-9bd1-8dacdc396a0d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.501707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a2d21-ca6f-4928-9bd1-8dacdc396a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.503633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a2d21-ca6f-4928-9bd1-8dacdc396a0d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.524913 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 986/1986] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:47 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:47.528986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11a55-234a-4021-ad0c-d1fb07ae46a5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.539255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11a55-234a-4021-ad0c-d1fb07ae46a5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.544357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96144f-f56b-4fc5-8b32-38336418c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.545020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96144f-f56b-4fc5-8b32-38336418c1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.545634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96144f-f56b-4fc5-8b32-38336418c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.545921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96144f-f56b-4fc5-8b32-38336418c1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.546636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96144f-f56b-4fc5-8b32-38336418c1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.548256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96144f-f56b-4fc5-8b32-38336418c1a9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.559487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1001/1987] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:47.563662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a2d21-ca6f-4928-9bd1-8dacdc396a0d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.573507 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a2d21-ca6f-4928-9bd1-8dacdc396a0d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.578234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6f1be-3840-41c1-a9b3-1ab42aad664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.579114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6f1be-3840-41c1-a9b3-1ab42aad664e admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.579388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6f1be-3840-41c1-a9b3-1ab42aad664e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.579659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6f1be-3840-41c1-a9b3-1ab42aad664e admin admin] PATH_INFO: `/v3/projects/e9af7f236cb345f484a4ce0410a6fdae/users/488fedbd50e34004a50e2b4fe0e6acf3/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.594328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6f1be-3840-41c1-a9b3-1ab42aad664e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9af7f236cb345f484a4ce0410a6fdae, user_id=488fedbd50e34004a50e2b4fe0e6acf3, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.596993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6f1be-3840-41c1-a9b3-1ab42aad664e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.609967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 987/1988] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:47 2022] PUT /identity/v3/projects/e9af7f236cb345f484a4ce0410a6fdae/users/488fedbd50e34004a50e2b4fe0e6acf3/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:47.613902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96144f-f56b-4fc5-8b32-38336418c1a9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.623818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96144f-f56b-4fc5-8b32-38336418c1a9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.684185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37457c29-d254-43d4-89ab-b221076b9d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.684689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37457c29-d254-43d4-89ab-b221076b9d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.684973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37457c29-d254-43d4-89ab-b221076b9d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.685241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37457c29-d254-43d4-89ab-b221076b9d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.686333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37457c29-d254-43d4-89ab-b221076b9d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.688067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37457c29-d254-43d4-89ab-b221076b9d6e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.702562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1002/1989] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:47.703912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6f1be-3840-41c1-a9b3-1ab42aad664e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.714683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6f1be-3840-41c1-a9b3-1ab42aad664e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.719358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.720361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.720550 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.720782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] PATH_INFO: `/v3/projects/e9af7f236cb345f484a4ce0410a6fdae/users/488fedbd50e34004a50e2b4fe0e6acf3/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.723710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9af7f236cb345f484a4ce0410a6fdae, user_id=488fedbd50e34004a50e2b4fe0e6acf3, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.726410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.738367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 988/1990] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:47 2022] PUT /identity/v3/projects/e9af7f236cb345f484a4ce0410a6fdae/users/488fedbd50e34004a50e2b4fe0e6acf3/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:47.749369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6321-ec42-4507-8cec-6222b70cf8de None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.749860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6321-ec42-4507-8cec-6222b70cf8de None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.750190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6321-ec42-4507-8cec-6222b70cf8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.775454 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-086c6321-ec42-4507-8cec-6222b70cf8de None None] MFA Rules not processed for user `488fedbd50e34004a50e2b4fe0e6acf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:47.776618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-086c6321-ec42-4507-8cec-6222b70cf8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:47.843227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1003/1991] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:47.854881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:47.856670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:47.912203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0bfbc-0525-4fb5-af3b-5242979ddd00 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:47.916103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8003-f69a-4fe0-ad63-3d514fb98263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:47.916751 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8003-f69a-4fe0-ad63-3d514fb98263 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:47.917034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8003-f69a-4fe0-ad63-3d514fb98263 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:47.917312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8003-f69a-4fe0-ad63-3d514fb98263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:47.973298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8003-f69a-4fe0-ad63-3d514fb98263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:47.974677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8003-f69a-4fe0-ad63-3d514fb98263 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:47.983676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 989/1992] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:50.553969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c6321-ec42-4507-8cec-6222b70cf8de None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:50.556269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-086c6321-ec42-4507-8cec-6222b70cf8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:50.664709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c6321-ec42-4507-8cec-6222b70cf8de None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:50.671046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:50.672228 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:50.672660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:50.673458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] PATH_INFO: `/v3/users/7585cf2746014429a8c2b2adf7858eeb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:50.674921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7585cf2746014429a8c2b2adf7858eeb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:50.677541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:50.725774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7585cf2746014429a8c2b2adf7858eeb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:50.738291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7585cf2746014429a8c2b2adf7858eeb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:50.739030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7585cf2746014429a8c2b2adf7858eeb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:50.746493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7585cf2746014429a8c2b2adf7858eeb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:50.755332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7585cf2746014429a8c2b2adf7858eeb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:50.765631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1004/1993] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:50 2022] DELETE /identity/v3/users/7585cf2746014429a8c2b2adf7858eeb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:50.767192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431157-64ae-43fd-b431-7b10faab2d2d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:50.767676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431157-64ae-43fd-b431-7b10faab2d2d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:50.768194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431157-64ae-43fd-b431-7b10faab2d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:50.796080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a3431157-64ae-43fd-b431-7b10faab2d2d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:50.798863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a3431157-64ae-43fd-b431-7b10faab2d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:50.905093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 990/1994] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:50.926491 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:50.927824 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:51.033673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04504f6d-93de-490d-92f1-976f60305efa admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:51.037739 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2220-f20b-4d5b-91ee-5da637caae70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:51.038634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2220-f20b-4d5b-91ee-5da637caae70 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:51.038912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2220-f20b-4d5b-91ee-5da637caae70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:51.039362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2220-f20b-4d5b-91ee-5da637caae70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:51.049983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2220-f20b-4d5b-91ee-5da637caae70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:51.051512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2220-f20b-4d5b-91ee-5da637caae70 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:51.061250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1005/1995] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:51.338615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431157-64ae-43fd-b431-7b10faab2d2d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:51.342499 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a3431157-64ae-43fd-b431-7b10faab2d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:51.357519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431157-64ae-43fd-b431-7b10faab2d2d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:51.362263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:51.363361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:51.363783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:51.364203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] PATH_INFO: `/v3/projects/6c489133bd254260826fc72d8d885633` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:51.365520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c489133bd254260826fc72d8d885633)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:51.368013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:51.418505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c489133bd254260826fc72d8d885633', 'request_id': 'req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.425434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c489133bd254260826fc72d8d885633', 'request_id': 'req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.439297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c489133bd254260826fc72d8d885633', 'request_id': 'req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.452508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] The token cache is being invalidate because project 6c489133bd254260826fc72d8d885633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:51.453987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.455234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.457084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 991/1996] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:51 2022] DELETE /identity/v3/projects/6c489133bd254260826fc72d8d885633 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:51.460901 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2220-f20b-4d5b-91ee-5da637caae70 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:51.484140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2220-f20b-4d5b-91ee-5da637caae70 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:51.559675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:51.561366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:51.561896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:51.562195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] PATH_INFO: `/v3/users/48b5184f8af648de9e2843ec6eb9d6b1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:51.563558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b5184f8af648de9e2843ec6eb9d6b1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:51.565671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:51.620585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b5184f8af648de9e2843ec6eb9d6b1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.634459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b5184f8af648de9e2843ec6eb9d6b1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.635552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b5184f8af648de9e2843ec6eb9d6b1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.644971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b5184f8af648de9e2843ec6eb9d6b1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.652429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-baa923b5-c2b6-4ac7-8e0b-b74f75bbded6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b5184f8af648de9e2843ec6eb9d6b1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.660431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1006/1997] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:51 2022] DELETE /identity/v3/users/48b5184f8af648de9e2843ec6eb9d6b1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:51.685934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:51.687524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:51.700370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1d97-d67f-4cfc-9b73-4ff534dba4d4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:51.758786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:51.759670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:51.759950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:51.760224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] PATH_INFO: `/v3/users/29ccb66a59694fce9986ab4c8e31075b` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:51.761408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ccb66a59694fce9986ab4c8e31075b)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:51.763369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:51.814409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ccb66a59694fce9986ab4c8e31075b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.827194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ccb66a59694fce9986ab4c8e31075b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.827910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ccb66a59694fce9986ab4c8e31075b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.828525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ccb66a59694fce9986ab4c8e31075b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.836833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ccb66a59694fce9986ab4c8e31075b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:51.850133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 992/1998] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:51 2022] DELETE /identity/v3/users/29ccb66a59694fce9986ab4c8e31075b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:51.856104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1627-0767-41fa-a1b4-c1b3bbc139c7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:51.856673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1627-0767-41fa-a1b4-c1b3bbc139c7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:51.856958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd1627-0767-41fa-a1b4-c1b3bbc139c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:51.874020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ebcd1627-0767-41fa-a1b4-c1b3bbc139c7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:51.875326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ebcd1627-0767-41fa-a1b4-c1b3bbc139c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:51.935993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:51.937709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:51.947019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1007/1999] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:51.956907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1627-0767-41fa-a1b4-c1b3bbc139c7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:51.958461 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ebcd1627-0767-41fa-a1b4-c1b3bbc139c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:51.962193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d81d8-6eb4-437f-8a5c-0322f56f3be4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:51.967028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:51.967889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:51.968170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:51.968442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] PATH_INFO: `/v3/projects/ec9ed82fe4294606b826d0284f19a904` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:51.969844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9ed82fe4294606b826d0284f19a904)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:51.971776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.033215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9ed82fe4294606b826d0284f19a904', 'request_id': 'req-db719f34-c921-41b0-8475-e7e419e5826b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.038458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd1627-0767-41fa-a1b4-c1b3bbc139c7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.040971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9ed82fe4294606b826d0284f19a904', 'request_id': 'req-db719f34-c921-41b0-8475-e7e419e5826b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.051504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9ed82fe4294606b826d0284f19a904', 'request_id': 'req-db719f34-c921-41b0-8475-e7e419e5826b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.069514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] The token cache is being invalidate because project ec9ed82fe4294606b826d0284f19a904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:52.070128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.071104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db719f34-c921-41b0-8475-e7e419e5826b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.072963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 993/2000] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:51 2022] DELETE /identity/v3/projects/ec9ed82fe4294606b826d0284f19a904 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:52.078344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f148-d300-404e-8165-0ede1e7064d1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.078624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f148-d300-404e-8165-0ede1e7064d1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.078894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f148-d300-404e-8165-0ede1e7064d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.106919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1696f148-d300-404e-8165-0ede1e7064d1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:52.109325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1696f148-d300-404e-8165-0ede1e7064d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:52.132571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.133255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.133564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.133847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.142524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:52.210718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 994/2001] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:52.220231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f58a-5b66-49a8-b943-f3d1447fcdd0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.220714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f58a-5b66-49a8-b943-f3d1447fcdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.221067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f58a-5b66-49a8-b943-f3d1447fcdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.230809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.233372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.244685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1008/2002] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:52.260576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f801f58a-5b66-49a8-b943-f3d1447fcdd0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:52.263487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f801f58a-5b66-49a8-b943-f3d1447fcdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:52.274948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 995/2003] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:52.279250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.290409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879b396-129e-48ac-9cfb-cb8b24c340c9 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.300471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.301433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.301928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.302218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.303669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:52.303965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.305765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.323388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1009/2004] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:52.327528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f58a-5b66-49a8-b943-f3d1447fcdd0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.338936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f58a-5b66-49a8-b943-f3d1447fcdd0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.349229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ee88-3667-43ec-ae40-c6c35996b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.350199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ee88-3667-43ec-ae40-c6c35996b150 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.350822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ee88-3667-43ec-ae40-c6c35996b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.351416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ee88-3667-43ec-ae40-c6c35996b150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.353325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ee88-3667-43ec-ae40-c6c35996b150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.357740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ee88-3667-43ec-ae40-c6c35996b150 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.406458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 996/2005] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:52 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:52.410700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.422782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2e8ad-d52b-49f6-a9aa-fbe1eb97e44e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.507230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f38d-dc50-4dab-96ff-971fc90ddced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.507952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f38d-dc50-4dab-96ff-971fc90ddced admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.508317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f38d-dc50-4dab-96ff-971fc90ddced admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.508752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f38d-dc50-4dab-96ff-971fc90ddced admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.509483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79f38d-dc50-4dab-96ff-971fc90ddced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.512393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79f38d-dc50-4dab-96ff-971fc90ddced admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.546470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1010/2006] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:52 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:52.548122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ee88-3667-43ec-ae40-c6c35996b150 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.558565 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ee88-3667-43ec-ae40-c6c35996b150 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.563050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.563709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.563985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.564253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.564975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.566629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.577768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 997/2007] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:52.582538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f38d-dc50-4dab-96ff-971fc90ddced admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.590702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.592896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:52.597322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f38d-dc50-4dab-96ff-971fc90ddced admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.602355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa20a-c72b-4c9f-8df7-6183e62c85b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.603154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa20a-c72b-4c9f-8df7-6183e62c85b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.603477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa20a-c72b-4c9f-8df7-6183e62c85b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.603806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa20a-c72b-4c9f-8df7-6183e62c85b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.604590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caa20a-c72b-4c9f-8df7-6183e62c85b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.606279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caa20a-c72b-4c9f-8df7-6183e62c85b3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.616999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1011/2008] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:52.620825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc5787-b943-4307-a69e-ef1c3b00c7e2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.621095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa20a-c72b-4c9f-8df7-6183e62c85b3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.626010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.626867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.627148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.627836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] PATH_INFO: `/v3/projects/5a3b99eca5084f58a36b82955a37f906` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.628576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3b99eca5084f58a36b82955a37f906)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.630664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.631230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa20a-c72b-4c9f-8df7-6183e62c85b3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.636469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38527ac9-d7d9-4d97-9e09-b7748dba09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.637393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38527ac9-d7d9-4d97-9e09-b7748dba09a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.637713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38527ac9-d7d9-4d97-9e09-b7748dba09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.637988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38527ac9-d7d9-4d97-9e09-b7748dba09a7 admin admin] PATH_INFO: `/v3/projects/b6b0a88026364b398639a9e1ff02dfa6/users/030c3f34bd1f48aab4225b9c33d48519/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.654893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38527ac9-d7d9-4d97-9e09-b7748dba09a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b0a88026364b398639a9e1ff02dfa6, user_id=030c3f34bd1f48aab4225b9c33d48519, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.657773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38527ac9-d7d9-4d97-9e09-b7748dba09a7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.673198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1012/2009] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:52 2022] PUT /identity/v3/projects/b6b0a88026364b398639a9e1ff02dfa6/users/030c3f34bd1f48aab4225b9c33d48519/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:52.683347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c3b4-a5f5-43c4-bd4c-7a39d7132f4c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.683635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c3b4-a5f5-43c4-bd4c-7a39d7132f4c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.683914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c3b4-a5f5-43c4-bd4c-7a39d7132f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.689514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3b99eca5084f58a36b82955a37f906', 'request_id': 'req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.695705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3b99eca5084f58a36b82955a37f906', 'request_id': 'req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.705567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3b99eca5084f58a36b82955a37f906', 'request_id': 'req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.716231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b8c1c3b4-a5f5-43c4-bd4c-7a39d7132f4c None None] MFA Rules not processed for user `030c3f34bd1f48aab4225b9c33d48519`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:52.716869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] The token cache is being invalidate because project 5a3b99eca5084f58a36b82955a37f906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:52.717052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.717487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b8c1c3b4-a5f5-43c4-bd4c-7a39d7132f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:52.717761 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.719318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 998/2010] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:52 2022] DELETE /identity/v3/projects/5a3b99eca5084f58a36b82955a37f906 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:52.724308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.725637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:52.779533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1013/2011] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:52.787707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7b9b0-5d7d-4aa3-ad97-c5302e2c81ce admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.791127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1c3b4-a5f5-43c4-bd4c-7a39d7132f4c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.792446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b8c1c3b4-a5f5-43c4-bd4c-7a39d7132f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:52.792971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.793917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.794202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.794474 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] PATH_INFO: `/v3/users/488fedbd50e34004a50e2b4fe0e6acf3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.796118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=488fedbd50e34004a50e2b4fe0e6acf3)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.798095 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.844440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488fedbd50e34004a50e2b4fe0e6acf3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.846889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1c3b4-a5f5-43c4-bd4c-7a39d7132f4c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.852877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.853727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.854115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.854414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.857572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488fedbd50e34004a50e2b4fe0e6acf3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.858279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488fedbd50e34004a50e2b4fe0e6acf3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.858888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488fedbd50e34004a50e2b4fe0e6acf3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.863754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.865222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:52.866042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3f84d1c1-f315-4431-b1a7-eb8be03a7abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488fedbd50e34004a50e2b4fe0e6acf3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:52.874897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1014/2012] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:52.879810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 999/2013] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:52 2022] DELETE /identity/v3/users/488fedbd50e34004a50e2b4fe0e6acf3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:52.899857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:52.901277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:52.914471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345b48-9b13-4462-9199-8b78b0d26fa0 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:52.971669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:52.972583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:52.972861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:52.973133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] PATH_INFO: `/v3/users/030c3f34bd1f48aab4225b9c33d48519` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:52.974336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030c3f34bd1f48aab4225b9c33d48519)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:52.976276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.029449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030c3f34bd1f48aab4225b9c33d48519'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.044433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030c3f34bd1f48aab4225b9c33d48519'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.045992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030c3f34bd1f48aab4225b9c33d48519'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.053910 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030c3f34bd1f48aab4225b9c33d48519'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.062630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030c3f34bd1f48aab4225b9c33d48519'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.069922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1015/2014] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:40:52 2022] DELETE /identity/v3/users/030c3f34bd1f48aab4225b9c33d48519 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:53.074946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ce22e-ef04-4ae8-8aff-0367f4a12882 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.075234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ce22e-ef04-4ae8-8aff-0367f4a12882 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.075510 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ce22e-ef04-4ae8-8aff-0367f4a12882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.098985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2f6ce22e-ef04-4ae8-8aff-0367f4a12882 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:53.100871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2f6ce22e-ef04-4ae8-8aff-0367f4a12882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.163271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.164733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.184957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1000/2015] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:53.195560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ce22e-ef04-4ae8-8aff-0367f4a12882 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.197301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2f6ce22e-ef04-4ae8-8aff-0367f4a12882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.246962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1e6f-39d4-4f11-ab51-6cbbc2012ce6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.254058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.254929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.255205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.255477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] PATH_INFO: `/v3/projects/e9af7f236cb345f484a4ce0410a6fdae` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.256679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9af7f236cb345f484a4ce0410a6fdae)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.258652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.262403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ce22e-ef04-4ae8-8aff-0367f4a12882 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.266361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b7e66-11b0-4626-92d4-7d022537513a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.267290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b7e66-11b0-4626-92d4-7d022537513a service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.267637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b7e66-11b0-4626-92d4-7d022537513a service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.267980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b7e66-11b0-4626-92d4-7d022537513a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.279010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b7e66-11b0-4626-92d4-7d022537513a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.280566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b7e66-11b0-4626-92d4-7d022537513a service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.292385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1001/2016] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:53.306487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9af7f236cb345f484a4ce0410a6fdae', 'request_id': 'req-3315557b-7e76-475d-b727-736f0de0b568'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.312759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9af7f236cb345f484a4ce0410a6fdae', 'request_id': 'req-3315557b-7e76-475d-b727-736f0de0b568'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.320820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9af7f236cb345f484a4ce0410a6fdae', 'request_id': 'req-3315557b-7e76-475d-b727-736f0de0b568'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.331806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] The token cache is being invalidate because project e9af7f236cb345f484a4ce0410a6fdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:53.332111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.332793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3315557b-7e76-475d-b727-736f0de0b568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.334765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1016/2017] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:53 2022] DELETE /identity/v3/projects/e9af7f236cb345f484a4ce0410a6fdae => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:53.340074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b39264-34a6-4efa-a588-477aef5f7b09 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.340361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b39264-34a6-4efa-a588-477aef5f7b09 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.340635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b39264-34a6-4efa-a588-477aef5f7b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.360676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-39b39264-34a6-4efa-a588-477aef5f7b09 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:53.361902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-39b39264-34a6-4efa-a588-477aef5f7b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.421290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1002/2018] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:53.429163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913e47-35f1-480c-8aa4-c1c32f313eeb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.429767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913e47-35f1-480c-8aa4-c1c32f313eeb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.430198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913e47-35f1-480c-8aa4-c1c32f313eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.459093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9e913e47-35f1-480c-8aa4-c1c32f313eeb None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:53.460321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9e913e47-35f1-480c-8aa4-c1c32f313eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.469598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1017/2019] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:53.474039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b39264-34a6-4efa-a588-477aef5f7b09 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.484421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b39264-34a6-4efa-a588-477aef5f7b09 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.489538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.490235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.490516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.490791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.491619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:53.491955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.493569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.505305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1003/2020] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:53.509522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913e47-35f1-480c-8aa4-c1c32f313eeb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.520712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913e47-35f1-480c-8aa4-c1c32f313eeb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.525443 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe831-1b9b-46ed-9bbb-4568b7eb7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.526131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe831-1b9b-46ed-9bbb-4568b7eb7de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.526408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe831-1b9b-46ed-9bbb-4568b7eb7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.526684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe831-1b9b-46ed-9bbb-4568b7eb7de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.527365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe831-1b9b-46ed-9bbb-4568b7eb7de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.529265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe831-1b9b-46ed-9bbb-4568b7eb7de1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.573407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1018/2021] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:53.577839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.591336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee9e48-45ac-4107-9ced-dc2fffdf3752 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.654000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.654675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.654949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.655375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.656072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.658011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.678276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1004/2022] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:53.682509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe831-1b9b-46ed-9bbb-4568b7eb7de1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.693133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe831-1b9b-46ed-9bbb-4568b7eb7de1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.697918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c590a-b9ec-4245-87f4-de034e2fca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.698581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c590a-b9ec-4245-87f4-de034e2fca59 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.698863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c590a-b9ec-4245-87f4-de034e2fca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.699403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c590a-b9ec-4245-87f4-de034e2fca59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.700330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.702010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.705459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c590a-b9ec-4245-87f4-de034e2fca59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.707144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c590a-b9ec-4245-87f4-de034e2fca59 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.717264 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede67292-bae6-4175-8094-84e311c9e7e4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.722241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.723177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.723458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.723723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] PATH_INFO: `/v3/projects/b6b0a88026364b398639a9e1ff02dfa6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.728040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1019/2023] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:53.730317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b0a88026364b398639a9e1ff02dfa6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.732238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.735644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c590a-b9ec-4245-87f4-de034e2fca59 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.747862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c590a-b9ec-4245-87f4-de034e2fca59 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.753112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c277d91-1ab0-42c3-a6f2-ac51688cf837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.753894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c277d91-1ab0-42c3-a6f2-ac51688cf837 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.754170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c277d91-1ab0-42c3-a6f2-ac51688cf837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.754440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c277d91-1ab0-42c3-a6f2-ac51688cf837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.755178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c277d91-1ab0-42c3-a6f2-ac51688cf837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.756760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c277d91-1ab0-42c3-a6f2-ac51688cf837 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.766900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1020/2024] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:53.771103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c277d91-1ab0-42c3-a6f2-ac51688cf837 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.780860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c277d91-1ab0-42c3-a6f2-ac51688cf837 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.785233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b0a88026364b398639a9e1ff02dfa6', 'request_id': 'req-43d27bca-586b-42d2-928a-ae92eb88bce9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.791667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b0a88026364b398639a9e1ff02dfa6', 'request_id': 'req-43d27bca-586b-42d2-928a-ae92eb88bce9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.800561 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b0a88026364b398639a9e1ff02dfa6', 'request_id': 'req-43d27bca-586b-42d2-928a-ae92eb88bce9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.810698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] The token cache is being invalidate because project b6b0a88026364b398639a9e1ff02dfa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:40:53.810977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.811602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-43d27bca-586b-42d2-928a-ae92eb88bce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:40:53.813161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1005/2025] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:40:53 2022] DELETE /identity/v3/projects/b6b0a88026364b398639a9e1ff02dfa6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:53.817990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4af96-7650-41d5-b3d9-b716adbb11d6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.818265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4af96-7650-41d5-b3d9-b716adbb11d6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.818534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4af96-7650-41d5-b3d9-b716adbb11d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.834944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7bd4af96-7650-41d5-b3d9-b716adbb11d6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:53.836120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7bd4af96-7650-41d5-b3d9-b716adbb11d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.837108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5208f-e2e1-4fce-b140-d0b8db72778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.838048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5208f-e2e1-4fce-b140-d0b8db72778e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.838437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5208f-e2e1-4fce-b140-d0b8db72778e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.838737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5208f-e2e1-4fce-b140-d0b8db72778e admin admin] PATH_INFO: `/v3/projects/5ecdb5fa0c9840ac8168f8d7f6eeae0c/users/46b30f7e3dc24d41b485f7926a578231/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.844107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1006/2026] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:53.852872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bbf23-5c6e-4520-94c5-5390b9d7b8e5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.853450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bbf23-5c6e-4520-94c5-5390b9d7b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.853450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bbf23-5c6e-4520-94c5-5390b9d7b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.853994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5208f-e2e1-4fce-b140-d0b8db72778e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecdb5fa0c9840ac8168f8d7f6eeae0c, user_id=46b30f7e3dc24d41b485f7926a578231, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.856838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5208f-e2e1-4fce-b140-d0b8db72778e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.870675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1021/2027] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:53 2022] PUT /identity/v3/projects/5ecdb5fa0c9840ac8168f8d7f6eeae0c/users/46b30f7e3dc24d41b485f7926a578231/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:53.871455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6a2bbf23-5c6e-4520-94c5-5390b9d7b8e5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:53.872614 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6a2bbf23-5c6e-4520-94c5-5390b9d7b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.882474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb040-9327-4e61-b9cf-5415729040e8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.882764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb040-9327-4e61-b9cf-5415729040e8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.883041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb040-9327-4e61-b9cf-5415729040e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.909278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5cedb040-9327-4e61-b9cf-5415729040e8 None None] MFA Rules not processed for user `46b30f7e3dc24d41b485f7926a578231`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:53.910606 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5cedb040-9327-4e61-b9cf-5415729040e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.930608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1007/2028] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:53.934866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bbf23-5c6e-4520-94c5-5390b9d7b8e5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.943390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bbf23-5c6e-4520-94c5-5390b9d7b8e5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.948023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.948664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.948942 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.949230 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.949992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:40:53.950295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.951903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.963132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1008/2029] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:40:53.967348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.974849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1022/2030] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:53.976496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80529ef-a379-4ac4-97a3-51416e536b6e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.979235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb040-9327-4e61-b9cf-5415729040e8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:53.980488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5cedb040-9327-4e61-b9cf-5415729040e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:53.981222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78986e-ce79-4aee-9d13-714037213f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:53.981894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78986e-ce79-4aee-9d13-714037213f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:53.982172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78986e-ce79-4aee-9d13-714037213f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:53.982443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78986e-ce79-4aee-9d13-714037213f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:53.983108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78986e-ce79-4aee-9d13-714037213f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:53.984984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78986e-ce79-4aee-9d13-714037213f24 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:53.993517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb040-9327-4e61-b9cf-5415729040e8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:53.998635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70981ad2-649e-42ba-ae9a-1956f4e11593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.000590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70981ad2-649e-42ba-ae9a-1956f4e11593 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.000868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70981ad2-649e-42ba-ae9a-1956f4e11593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.001383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70981ad2-649e-42ba-ae9a-1956f4e11593 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.002251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70981ad2-649e-42ba-ae9a-1956f4e11593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.004418 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70981ad2-649e-42ba-ae9a-1956f4e11593 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.011442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1009/2031] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:54.015568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78986e-ce79-4aee-9d13-714037213f24 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.034686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1023/2032] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:53 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:54.038603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70981ad2-649e-42ba-ae9a-1956f4e11593 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.075053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78986e-ce79-4aee-9d13-714037213f24 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.096528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70981ad2-649e-42ba-ae9a-1956f4e11593 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.101104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b41d7-343d-47f6-89af-45c950782eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.101808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b41d7-343d-47f6-89af-45c950782eea admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.102081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b41d7-343d-47f6-89af-45c950782eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.102349 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b41d7-343d-47f6-89af-45c950782eea admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.103028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b41d7-343d-47f6-89af-45c950782eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.104930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b41d7-343d-47f6-89af-45c950782eea admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.125881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1024/2033] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:54 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:54.130189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b41d7-343d-47f6-89af-45c950782eea admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.132360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f52cf-c62f-4d40-a23e-e11fcf83aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.133045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f52cf-c62f-4d40-a23e-e11fcf83aeaf admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.133443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f52cf-c62f-4d40-a23e-e11fcf83aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.133904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f52cf-c62f-4d40-a23e-e11fcf83aeaf admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.134655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f52cf-c62f-4d40-a23e-e11fcf83aeaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.136858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f52cf-c62f-4d40-a23e-e11fcf83aeaf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.139751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b41d7-343d-47f6-89af-45c950782eea admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.150968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc8bb2-705e-4374-87d8-9e40bcc280f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.151665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8bb2-705e-4374-87d8-9e40bcc280f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.151942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8bb2-705e-4374-87d8-9e40bcc280f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.152210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8bb2-705e-4374-87d8-9e40bcc280f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.152956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc8bb2-705e-4374-87d8-9e40bcc280f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.154695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc8bb2-705e-4374-87d8-9e40bcc280f8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.161743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1010/2034] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:54 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:54.165182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f52cf-c62f-4d40-a23e-e11fcf83aeaf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.167948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1025/2035] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:54.168872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc8bb2-705e-4374-87d8-9e40bcc280f8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.175499 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f52cf-c62f-4d40-a23e-e11fcf83aeaf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.178562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc8bb2-705e-4374-87d8-9e40bcc280f8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.179952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a3e9-8bb6-45c8-8a3f-499e2ec299eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.180603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a3e9-8bb6-45c8-8a3f-499e2ec299eb admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.180876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a3e9-8bb6-45c8-8a3f-499e2ec299eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.181145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a3e9-8bb6-45c8-8a3f-499e2ec299eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.181896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826a3e9-8bb6-45c8-8a3f-499e2ec299eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.183197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ff2e-e626-4b27-b834-53a5d0349a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.183468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826a3e9-8bb6-45c8-8a3f-499e2ec299eb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.183820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ff2e-e626-4b27-b834-53a5d0349a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.184098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ff2e-e626-4b27-b834-53a5d0349a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.184363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ff2e-e626-4b27-b834-53a5d0349a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.185121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ff2e-e626-4b27-b834-53a5d0349a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.186712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ff2e-e626-4b27-b834-53a5d0349a55 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.193279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1011/2036] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:54.196931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1026/2037] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:54.197045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a3e9-8bb6-45c8-8a3f-499e2ec299eb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.200661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ff2e-e626-4b27-b834-53a5d0349a55 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.207504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a3e9-8bb6-45c8-8a3f-499e2ec299eb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.210056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ff2e-e626-4b27-b834-53a5d0349a55 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.212244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a63d-3dfa-477b-b281-ac0fc0099b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.212911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a63d-3dfa-477b-b281-ac0fc0099b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.213189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a63d-3dfa-477b-b281-ac0fc0099b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.213657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a63d-3dfa-477b-b281-ac0fc0099b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.214393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a63d-3dfa-477b-b281-ac0fc0099b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.214524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086cee-d9c9-41b5-8a64-feafa60b1f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.215346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086cee-d9c9-41b5-8a64-feafa60b1f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.215620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086cee-d9c9-41b5-8a64-feafa60b1f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.215893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086cee-d9c9-41b5-8a64-feafa60b1f30 admin admin] PATH_INFO: `/v3/projects/7d358d0836414be5acae522aba228b5d/users/69b726f537dd489db457db594a890a82/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.216004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a63d-3dfa-477b-b281-ac0fc0099b05 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.229136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1012/2038] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:54.229783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2086cee-d9c9-41b5-8a64-feafa60b1f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d358d0836414be5acae522aba228b5d, user_id=69b726f537dd489db457db594a890a82, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.230168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a63d-3dfa-477b-b281-ac0fc0099b05 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.232410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2086cee-d9c9-41b5-8a64-feafa60b1f30 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.239689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a63d-3dfa-477b-b281-ac0fc0099b05 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.245229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1027/2039] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:54 2022] PUT /identity/v3/projects/7d358d0836414be5acae522aba228b5d/users/69b726f537dd489db457db594a890a82/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:54.256516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338757-dcfe-4feb-bf92-01b0993355ee None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.256820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338757-dcfe-4feb-bf92-01b0993355ee None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.257087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338757-dcfe-4feb-bf92-01b0993355ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.283203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6d338757-dcfe-4feb-bf92-01b0993355ee None None] MFA Rules not processed for user `69b726f537dd489db457db594a890a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:54.284457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6d338757-dcfe-4feb-bf92-01b0993355ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:54.294315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940c5d6-1789-4973-b6f2-b55f929f7898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.295496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940c5d6-1789-4973-b6f2-b55f929f7898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.295779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940c5d6-1789-4973-b6f2-b55f929f7898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.296050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940c5d6-1789-4973-b6f2-b55f929f7898 admin admin] PATH_INFO: `/v3/projects/ddc04645d70d4724a7bfff91bcefb7a8/users/776017ba9a834baa98feadf339676a82/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.310466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940c5d6-1789-4973-b6f2-b55f929f7898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc04645d70d4724a7bfff91bcefb7a8, user_id=776017ba9a834baa98feadf339676a82, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.313155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940c5d6-1789-4973-b6f2-b55f929f7898 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.327423 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1013/2040] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:54 2022] PUT /identity/v3/projects/ddc04645d70d4724a7bfff91bcefb7a8/users/776017ba9a834baa98feadf339676a82/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:54.338704 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf3503-205c-4527-94d7-3acc4072424e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.339023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf3503-205c-4527-94d7-3acc4072424e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.339293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf3503-205c-4527-94d7-3acc4072424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.349385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1028/2041] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:54.353795 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d338757-dcfe-4feb-bf92-01b0993355ee None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.363957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d338757-dcfe-4feb-bf92-01b0993355ee None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.365663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-abcf3503-205c-4527-94d7-3acc4072424e None None] MFA Rules not processed for user `776017ba9a834baa98feadf339676a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:54.366945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-abcf3503-205c-4527-94d7-3acc4072424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:54.418036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8160f96-6a5c-4af2-b6bf-af731c6bea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.418801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160f96-6a5c-4af2-b6bf-af731c6bea8f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.419079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160f96-6a5c-4af2-b6bf-af731c6bea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.419343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160f96-6a5c-4af2-b6bf-af731c6bea8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.420013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8160f96-6a5c-4af2-b6bf-af731c6bea8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.422247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8160f96-6a5c-4af2-b6bf-af731c6bea8f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.428006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1014/2042] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:40:54.439446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf3503-205c-4527-94d7-3acc4072424e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.440873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-abcf3503-205c-4527-94d7-3acc4072424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:54.447638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1029/2043] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:40:54 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:40:54.451571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8160f96-6a5c-4af2-b6bf-af731c6bea8f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.497745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf3503-205c-4527-94d7-3acc4072424e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.514063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8160f96-6a5c-4af2-b6bf-af731c6bea8f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.519663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc671-04bd-417d-8650-ff0371cc82df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.520336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc671-04bd-417d-8650-ff0371cc82df admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.520615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc671-04bd-417d-8650-ff0371cc82df admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.520889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc671-04bd-417d-8650-ff0371cc82df admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.521599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc671-04bd-417d-8650-ff0371cc82df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.523541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc671-04bd-417d-8650-ff0371cc82df admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.546991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1030/2044] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:40:54 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:40:54.547870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b492575-6c2f-4ed4-ad47-ec4ceafca2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.548291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc671-04bd-417d-8650-ff0371cc82df admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.548529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b492575-6c2f-4ed4-ad47-ec4ceafca2ed service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.548934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b492575-6c2f-4ed4-ad47-ec4ceafca2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.549213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b492575-6c2f-4ed4-ad47-ec4ceafca2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.558519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc671-04bd-417d-8650-ff0371cc82df admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.569467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b7fb-f279-4a17-a4e8-c0e7f339e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.570417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b7fb-f279-4a17-a4e8-c0e7f339e46a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.570859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b7fb-f279-4a17-a4e8-c0e7f339e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.571277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b7fb-f279-4a17-a4e8-c0e7f339e46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.572149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614b7fb-f279-4a17-a4e8-c0e7f339e46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.573928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614b7fb-f279-4a17-a4e8-c0e7f339e46a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.584539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1031/2045] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:40:54.588285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b7fb-f279-4a17-a4e8-c0e7f339e46a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.598873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b7fb-f279-4a17-a4e8-c0e7f339e46a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.603551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634163e-bbe5-47e5-af87-a3f509753f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.604516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634163e-bbe5-47e5-af87-a3f509753f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.604758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634163e-bbe5-47e5-af87-a3f509753f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.605031 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634163e-bbe5-47e5-af87-a3f509753f74 admin admin] PATH_INFO: `/v3/projects/0a5be63c85b849718674b9aaf87ebd4e/users/cbdcef8a482348d59f4cb8e1c47a5e25/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.611611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b492575-6c2f-4ed4-ad47-ec4ceafca2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.613126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b492575-6c2f-4ed4-ad47-ec4ceafca2ed service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.623705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634163e-bbe5-47e5-af87-a3f509753f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5be63c85b849718674b9aaf87ebd4e, user_id=cbdcef8a482348d59f4cb8e1c47a5e25, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.626510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634163e-bbe5-47e5-af87-a3f509753f74 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.627992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1015/2046] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:40:54.645596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1032/2047] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:54 2022] PUT /identity/v3/projects/0a5be63c85b849718674b9aaf87ebd4e/users/cbdcef8a482348d59f4cb8e1c47a5e25/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:40:54.649647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b492575-6c2f-4ed4-ad47-ec4ceafca2ed service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.661175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b492575-6c2f-4ed4-ad47-ec4ceafca2ed service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.737575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67182a7e-5407-416c-ad97-be63f10c3159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.738298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182a7e-5407-416c-ad97-be63f10c3159 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.738574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182a7e-5407-416c-ad97-be63f10c3159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.738842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182a7e-5407-416c-ad97-be63f10c3159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.739572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67182a7e-5407-416c-ad97-be63f10c3159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.741164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67182a7e-5407-416c-ad97-be63f10c3159 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.757388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634163e-bbe5-47e5-af87-a3f509753f74 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:54.757940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1016/2048] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:40:54.772984 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634163e-bbe5-47e5-af87-a3f509753f74 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:54.779806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79435-92b9-4bd5-bc01-808b1ce24d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:54.781129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79435-92b9-4bd5-bc01-808b1ce24d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.781414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79435-92b9-4bd5-bc01-808b1ce24d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.781734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79435-92b9-4bd5-bc01-808b1ce24d62 admin admin] PATH_INFO: `/v3/projects/0a5be63c85b849718674b9aaf87ebd4e/users/cbdcef8a482348d59f4cb8e1c47a5e25/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.783801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79435-92b9-4bd5-bc01-808b1ce24d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5be63c85b849718674b9aaf87ebd4e, user_id=cbdcef8a482348d59f4cb8e1c47a5e25, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:54.786655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79435-92b9-4bd5-bc01-808b1ce24d62 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:54.802912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1033/2049] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:40:54 2022] PUT /identity/v3/projects/0a5be63c85b849718674b9aaf87ebd4e/users/cbdcef8a482348d59f4cb8e1c47a5e25/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:40:54.813758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc931-a6ec-4ab3-93c4-44cc489d2a47 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:54.814043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc931-a6ec-4ab3-93c4-44cc489d2a47 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:54.814322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc931-a6ec-4ab3-93c4-44cc489d2a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:54.851226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ddbfc931-a6ec-4ab3-93c4-44cc489d2a47 None None] MFA Rules not processed for user `cbdcef8a482348d59f4cb8e1c47a5e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:40:54.851226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ddbfc931-a6ec-4ab3-93c4-44cc489d2a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:54.924753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1017/2050] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:40:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:40:54.941419 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79435-92b9-4bd5-bc01-808b1ce24d62 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:55.011983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79435-92b9-4bd5-bc01-808b1ce24d62 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:55.015619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113107b-51a9-414c-9c88-85631caf3f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:55.016263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113107b-51a9-414c-9c88-85631caf3f30 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:55.016538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113107b-51a9-414c-9c88-85631caf3f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:55.016811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113107b-51a9-414c-9c88-85631caf3f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:55.072890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113107b-51a9-414c-9c88-85631caf3f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:55.074377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113107b-51a9-414c-9c88-85631caf3f30 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:55.083351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1034/2051] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:56.599363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc931-a6ec-4ab3-93c4-44cc489d2a47 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:56.601089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ddbfc931-a6ec-4ab3-93c4-44cc489d2a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:40:56.613330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc931-a6ec-4ab3-93c4-44cc489d2a47 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:56.617339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d787bf-b348-47a3-b9be-7b5de9f9fe92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:56.618053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d787bf-b348-47a3-b9be-7b5de9f9fe92 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:56.618328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d787bf-b348-47a3-b9be-7b5de9f9fe92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:56.618626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d787bf-b348-47a3-b9be-7b5de9f9fe92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:56.683647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d787bf-b348-47a3-b9be-7b5de9f9fe92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:56.685090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d787bf-b348-47a3-b9be-7b5de9f9fe92 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:56.694185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1018/2052] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:40:59.268198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113107b-51a9-414c-9c88-85631caf3f30 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:40:59.277044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113107b-51a9-414c-9c88-85631caf3f30 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:40:59.280887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b018f-c850-4201-af07-1043f59c79e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:40:59.281456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b018f-c850-4201-af07-1043f59c79e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:40:59.281828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b018f-c850-4201-af07-1043f59c79e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:40:59.282173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b018f-c850-4201-af07-1043f59c79e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:40:59.292507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b018f-c850-4201-af07-1043f59c79e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:40:59.294588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b018f-c850-4201-af07-1043f59c79e3 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:40:59.308554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1035/2053] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:40:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:02.997091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d787bf-b348-47a3-b9be-7b5de9f9fe92 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:03.071401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d787bf-b348-47a3-b9be-7b5de9f9fe92 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:03.077501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:03.078473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:03.078821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:03.079328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] PATH_INFO: `/v3/users/776017ba9a834baa98feadf339676a82` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:03.080827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776017ba9a834baa98feadf339676a82)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:03.082946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:03.134339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776017ba9a834baa98feadf339676a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:03.146160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776017ba9a834baa98feadf339676a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:03.146890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776017ba9a834baa98feadf339676a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:03.147749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776017ba9a834baa98feadf339676a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:03.154980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776017ba9a834baa98feadf339676a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:03.167871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1019/2054] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:02 2022] DELETE /identity/v3/users/776017ba9a834baa98feadf339676a82 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:03.172632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b277-47ed-4e91-b2ae-00b56b8d8b9e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:03.173080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b277-47ed-4e91-b2ae-00b56b8d8b9e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:03.173168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b277-47ed-4e91-b2ae-00b56b8d8b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:03.189787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f4d6b277-47ed-4e91-b2ae-00b56b8d8b9e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:03.191006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f4d6b277-47ed-4e91-b2ae-00b56b8d8b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:03.250080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1036/2055] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:03.260641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:03.262156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:03.320561 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75107db-9a6f-4ec0-adf7-663f32ef1702 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:03.324728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b96c68-1181-4eea-9425-2dc6f9e0eada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:03.325582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b96c68-1181-4eea-9425-2dc6f9e0eada service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:03.325910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b96c68-1181-4eea-9425-2dc6f9e0eada service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:03.326186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b96c68-1181-4eea-9425-2dc6f9e0eada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:03.336899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b96c68-1181-4eea-9425-2dc6f9e0eada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:03.338512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b96c68-1181-4eea-9425-2dc6f9e0eada service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:03.349044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1020/2056] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:04.019754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b277-47ed-4e91-b2ae-00b56b8d8b9e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.022331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f4d6b277-47ed-4e91-b2ae-00b56b8d8b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:04.040114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b277-47ed-4e91-b2ae-00b56b8d8b9e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:04.049252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:04.050458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.050900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.051571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] PATH_INFO: `/v3/projects/ddc04645d70d4724a7bfff91bcefb7a8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.054943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc04645d70d4724a7bfff91bcefb7a8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:04.057581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:04.150817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc04645d70d4724a7bfff91bcefb7a8', 'request_id': 'req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:04.170986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc04645d70d4724a7bfff91bcefb7a8', 'request_id': 'req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:04.183014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc04645d70d4724a7bfff91bcefb7a8', 'request_id': 'req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:04.204674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] The token cache is being invalidate because project ddc04645d70d4724a7bfff91bcefb7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:04.205525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:04.206633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b8f4ce56-4fc9-477b-aaca-11130e8a51f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:04.209009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1037/2057] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:04 2022] DELETE /identity/v3/projects/ddc04645d70d4724a7bfff91bcefb7a8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:04.213795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9ca2-036b-4133-85b8-39c775ec1e82 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.214269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9ca2-036b-4133-85b8-39c775ec1e82 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.214361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9ca2-036b-4133-85b8-39c775ec1e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.232273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3a4f9ca2-036b-4133-85b8-39c775ec1e82 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:04.233461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3a4f9ca2-036b-4133-85b8-39c775ec1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:04.315350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1021/2058] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:04.323194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17e947-430b-4802-b4c2-a8f3ae913e3c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.323498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17e947-430b-4802-b4c2-a8f3ae913e3c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.323782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17e947-430b-4802-b4c2-a8f3ae913e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.356585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ba17e947-430b-4802-b4c2-a8f3ae913e3c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:04.358215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ba17e947-430b-4802-b4c2-a8f3ae913e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:04.367526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1038/2059] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:04.372453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f9ca2-036b-4133-85b8-39c775ec1e82 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.383928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f9ca2-036b-4133-85b8-39c775ec1e82 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:04.390421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:04.391220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.391575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.391803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.392535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:04.392843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:04.394542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:04.407412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1022/2060] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:41:04.412098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17e947-430b-4802-b4c2-a8f3ae913e3c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.421965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17e947-430b-4802-b4c2-a8f3ae913e3c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:04.427181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c63d4-177b-44b1-a71e-f1116fdfbae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:04.427660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c63d4-177b-44b1-a71e-f1116fdfbae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.427940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c63d4-177b-44b1-a71e-f1116fdfbae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.428209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c63d4-177b-44b1-a71e-f1116fdfbae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.428900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c63d4-177b-44b1-a71e-f1116fdfbae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:04.430869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c63d4-177b-44b1-a71e-f1116fdfbae6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:04.459046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1039/2061] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:04 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:04.464138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.475780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990471-fa32-492e-b459-08d3011c0665 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:04.540997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6571b8-1325-4c2f-8b17-211edbf5c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:04.541736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6571b8-1325-4c2f-8b17-211edbf5c7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.542017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6571b8-1325-4c2f-8b17-211edbf5c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.542287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6571b8-1325-4c2f-8b17-211edbf5c7bb admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.542994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6571b8-1325-4c2f-8b17-211edbf5c7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:04.544908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6571b8-1325-4c2f-8b17-211edbf5c7bb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:04.568878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1023/2062] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:04 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:04.574316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c63d4-177b-44b1-a71e-f1116fdfbae6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.589138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c63d4-177b-44b1-a71e-f1116fdfbae6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:04.594297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36338b-396b-4b2f-a38a-08e0ebd92d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:04.594953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36338b-396b-4b2f-a38a-08e0ebd92d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.595236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36338b-396b-4b2f-a38a-08e0ebd92d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.595515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36338b-396b-4b2f-a38a-08e0ebd92d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.596241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36338b-396b-4b2f-a38a-08e0ebd92d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:04.597883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36338b-396b-4b2f-a38a-08e0ebd92d1b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:04.611010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1040/2063] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:04.616489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6571b8-1325-4c2f-8b17-211edbf5c7bb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.633175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6571b8-1325-4c2f-8b17-211edbf5c7bb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:04.640828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f425a9d-a73e-4af0-bfe1-93fc71af588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:04.641572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425a9d-a73e-4af0-bfe1-93fc71af588b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.641882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425a9d-a73e-4af0-bfe1-93fc71af588b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.642256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425a9d-a73e-4af0-bfe1-93fc71af588b admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.643313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f425a9d-a73e-4af0-bfe1-93fc71af588b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:04.645737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f425a9d-a73e-4af0-bfe1-93fc71af588b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:04.657134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1024/2064] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:04.661305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36338b-396b-4b2f-a38a-08e0ebd92d1b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.672600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36338b-396b-4b2f-a38a-08e0ebd92d1b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:04.678209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc9749-69c0-426a-a2fd-1912d3f52da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:04.679083 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc9749-69c0-426a-a2fd-1912d3f52da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.679354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc9749-69c0-426a-a2fd-1912d3f52da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.679587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc9749-69c0-426a-a2fd-1912d3f52da1 admin admin] PATH_INFO: `/v3/projects/8c15b1c8c2604ea48fd6f3319ebceadc/users/2d1c20085ae549fda1a3024c445540a0/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.695426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc9749-69c0-426a-a2fd-1912d3f52da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c15b1c8c2604ea48fd6f3319ebceadc, user_id=2d1c20085ae549fda1a3024c445540a0, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:04.698320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc9749-69c0-426a-a2fd-1912d3f52da1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:04.717200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1041/2065] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:04 2022] PUT /identity/v3/projects/8c15b1c8c2604ea48fd6f3319ebceadc/users/2d1c20085ae549fda1a3024c445540a0/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:04.733812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56b869-a4e9-4c68-8dbf-b73ab5a851f6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.734113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56b869-a4e9-4c68-8dbf-b73ab5a851f6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.734475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56b869-a4e9-4c68-8dbf-b73ab5a851f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.762302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9e56b869-a4e9-4c68-8dbf-b73ab5a851f6 None None] MFA Rules not processed for user `2d1c20085ae549fda1a3024c445540a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:04.763528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9e56b869-a4e9-4c68-8dbf-b73ab5a851f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:04.834391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1025/2066] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:04.835743 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc9749-69c0-426a-a2fd-1912d3f52da1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.916438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc9749-69c0-426a-a2fd-1912d3f52da1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:04.925224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4dc0c-23e8-4dee-a4e1-4acc67df5a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:04.925945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4dc0c-23e8-4dee-a4e1-4acc67df5a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:04.926945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4dc0c-23e8-4dee-a4e1-4acc67df5a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:04.927256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4dc0c-23e8-4dee-a4e1-4acc67df5a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:04.927911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4dc0c-23e8-4dee-a4e1-4acc67df5a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:04.929873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4dc0c-23e8-4dee-a4e1-4acc67df5a75 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:04.959580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1042/2067] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:04 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:04.965645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56b869-a4e9-4c68-8dbf-b73ab5a851f6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:04.976948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56b869-a4e9-4c68-8dbf-b73ab5a851f6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.040053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311408f-f375-4d76-80d3-53d0675bf9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.040805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311408f-f375-4d76-80d3-53d0675bf9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.041089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311408f-f375-4d76-80d3-53d0675bf9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.041500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311408f-f375-4d76-80d3-53d0675bf9bf admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.042379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311408f-f375-4d76-80d3-53d0675bf9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.045434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311408f-f375-4d76-80d3-53d0675bf9bf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.073778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1026/2068] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:04 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:05.078064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4dc0c-23e8-4dee-a4e1-4acc67df5a75 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.091202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4dc0c-23e8-4dee-a4e1-4acc67df5a75 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.098430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8aa0b-90c8-40c7-8f9e-2f542effcfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.106294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8aa0b-90c8-40c7-8f9e-2f542effcfee admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.106719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8aa0b-90c8-40c7-8f9e-2f542effcfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.108426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8aa0b-90c8-40c7-8f9e-2f542effcfee admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.108426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8aa0b-90c8-40c7-8f9e-2f542effcfee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.110045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8aa0b-90c8-40c7-8f9e-2f542effcfee admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.129465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1043/2069] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:05.131695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311408f-f375-4d76-80d3-53d0675bf9bf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.142834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311408f-f375-4d76-80d3-53d0675bf9bf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.149074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb696d-7621-432d-82bf-e7cb1a90c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.149776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb696d-7621-432d-82bf-e7cb1a90c5df admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.150054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb696d-7621-432d-82bf-e7cb1a90c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.150319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb696d-7621-432d-82bf-e7cb1a90c5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.151321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb696d-7621-432d-82bf-e7cb1a90c5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.153233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb696d-7621-432d-82bf-e7cb1a90c5df admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.165578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1027/2070] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:05.168270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8aa0b-90c8-40c7-8f9e-2f542effcfee admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.179223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8aa0b-90c8-40c7-8f9e-2f542effcfee admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.185724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcefe8-e0db-4a6e-9129-e584839c8ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.186538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcefe8-e0db-4a6e-9129-e584839c8ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.187223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcefe8-e0db-4a6e-9129-e584839c8ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.187847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcefe8-e0db-4a6e-9129-e584839c8ce4 admin admin] PATH_INFO: `/v3/projects/340d9f78c2684129aaf1a66edcdcaf5a/users/c0155e92eee04b3d80eb83bacb0d31f7/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.206233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcefe8-e0db-4a6e-9129-e584839c8ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340d9f78c2684129aaf1a66edcdcaf5a, user_id=c0155e92eee04b3d80eb83bacb0d31f7, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.211440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcefe8-e0db-4a6e-9129-e584839c8ce4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.227190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1044/2071] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:05 2022] PUT /identity/v3/projects/340d9f78c2684129aaf1a66edcdcaf5a/users/c0155e92eee04b3d80eb83bacb0d31f7/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:05.238277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f3a0-b206-40db-a16b-f1fd66c18c6d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.238729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f3a0-b206-40db-a16b-f1fd66c18c6d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.238910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f3a0-b206-40db-a16b-f1fd66c18c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.267954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e8d4f3a0-b206-40db-a16b-f1fd66c18c6d None None] MFA Rules not processed for user `c0155e92eee04b3d80eb83bacb0d31f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:05.269382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e8d4f3a0-b206-40db-a16b-f1fd66c18c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:05.359806 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1028/2072] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:05.365739 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcefe8-e0db-4a6e-9129-e584839c8ce4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.483340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcefe8-e0db-4a6e-9129-e584839c8ce4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.489488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a217afe-86e6-41c9-a9f1-0ff917f80def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.490180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217afe-86e6-41c9-a9f1-0ff917f80def admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.490484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217afe-86e6-41c9-a9f1-0ff917f80def admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.490722 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217afe-86e6-41c9-a9f1-0ff917f80def admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.491586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a217afe-86e6-41c9-a9f1-0ff917f80def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.493512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a217afe-86e6-41c9-a9f1-0ff917f80def admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.527355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1045/2073] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:05 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:05.531194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f3a0-b206-40db-a16b-f1fd66c18c6d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.550920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f3a0-b206-40db-a16b-f1fd66c18c6d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.637923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.639178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.639467 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.640008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.640744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.642728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.673539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1029/2074] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:05 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:05.674830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a217afe-86e6-41c9-a9f1-0ff917f80def admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.686178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.688084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:05.689205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a217afe-86e6-41c9-a9f1-0ff917f80def admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.694054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dffe68-de38-419b-91f9-67ca182cfcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.694798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dffe68-de38-419b-91f9-67ca182cfcff admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.695142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dffe68-de38-419b-91f9-67ca182cfcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.695718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dffe68-de38-419b-91f9-67ca182cfcff admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.696880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dffe68-de38-419b-91f9-67ca182cfcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.699035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dffe68-de38-419b-91f9-67ca182cfcff admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.700213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20d7c1-3e3c-42f7-841b-a02e391a51b9 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.705442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.711514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.711856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.712139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] PATH_INFO: `/v3/users/ab675b5f7a7849b9afb394b7b9321009` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.713473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab675b5f7a7849b9afb394b7b9321009)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.714169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1046/2075] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:05.718214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dffe68-de38-419b-91f9-67ca182cfcff admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.718794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.728777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dffe68-de38-419b-91f9-67ca182cfcff admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.738007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948948f-5e37-4ab5-b2d4-daf0817f8efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.738923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948948f-5e37-4ab5-b2d4-daf0817f8efb admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.739197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948948f-5e37-4ab5-b2d4-daf0817f8efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.739467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948948f-5e37-4ab5-b2d4-daf0817f8efb admin admin] PATH_INFO: `/v3/projects/19ceff83a740463cafbf9c1938578d46/users/96b48326d5144a97855fac7acb8fabad/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.754450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948948f-5e37-4ab5-b2d4-daf0817f8efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ceff83a740463cafbf9c1938578d46, user_id=96b48326d5144a97855fac7acb8fabad, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.757271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948948f-5e37-4ab5-b2d4-daf0817f8efb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.769452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab675b5f7a7849b9afb394b7b9321009'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:05.769817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1047/2076] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:05 2022] PUT /identity/v3/projects/19ceff83a740463cafbf9c1938578d46/users/96b48326d5144a97855fac7acb8fabad/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:05.773687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948948f-5e37-4ab5-b2d4-daf0817f8efb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.780695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab675b5f7a7849b9afb394b7b9321009'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:05.781370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab675b5f7a7849b9afb394b7b9321009'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:05.782000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab675b5f7a7849b9afb394b7b9321009'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:05.788512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-94a18338-17e0-4e4d-b4cd-5d8f0ed9cdbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab675b5f7a7849b9afb394b7b9321009'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:05.802105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1030/2077] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:05 2022] DELETE /identity/v3/users/ab675b5f7a7849b9afb394b7b9321009 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:05.806488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176c392-3bf9-498f-901c-26acc5dd9ed0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.806851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176c392-3bf9-498f-901c-26acc5dd9ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.807242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176c392-3bf9-498f-901c-26acc5dd9ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.825536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f176c392-3bf9-498f-901c-26acc5dd9ed0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:05.826744 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f176c392-3bf9-498f-901c-26acc5dd9ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:05.833676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948948f-5e37-4ab5-b2d4-daf0817f8efb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.887699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1031/2078] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:05.889986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.891579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.891579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.891579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.892326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.894448 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.897221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176c392-3bf9-498f-901c-26acc5dd9ed0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.898677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f176c392-3bf9-498f-901c-26acc5dd9ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:05.905778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1048/2079] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:05.910470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:05.912209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:05.924556 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f22f-982a-4e9c-97b2-68148b555645 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.929249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d7a3-4c00-43f1-ae14-6d9a7a2eed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:05.930198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d7a3-4c00-43f1-ae14-6d9a7a2eed5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.930451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d7a3-4c00-43f1-ae14-6d9a7a2eed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.930725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d7a3-4c00-43f1-ae14-6d9a7a2eed5d admin admin] PATH_INFO: `/v3/projects/19ceff83a740463cafbf9c1938578d46/users/96b48326d5144a97855fac7acb8fabad/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.932682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d7a3-4c00-43f1-ae14-6d9a7a2eed5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ceff83a740463cafbf9c1938578d46, user_id=96b48326d5144a97855fac7acb8fabad, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:05.935373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d7a3-4c00-43f1-ae14-6d9a7a2eed5d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:05.946208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1049/2080] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:05 2022] PUT /identity/v3/projects/19ceff83a740463cafbf9c1938578d46/users/96b48326d5144a97855fac7acb8fabad/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:05.956252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd8109-cd33-46b5-8249-304ce1bb5d2a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:05.956452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd8109-cd33-46b5-8249-304ce1bb5d2a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:05.956736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd8109-cd33-46b5-8249-304ce1bb5d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:05.963269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176c392-3bf9-498f-901c-26acc5dd9ed0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:05.983427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-49bd8109-cd33-46b5-8249-304ce1bb5d2a None None] MFA Rules not processed for user `96b48326d5144a97855fac7acb8fabad`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:05.984666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-49bd8109-cd33-46b5-8249-304ce1bb5d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:06.013858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:06.014627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:06.014791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:06.015032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:06.052943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1050/2081] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:06.064610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd8109-cd33-46b5-8249-304ce1bb5d2a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:06.066005 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-49bd8109-cd33-46b5-8249-304ce1bb5d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:06.075627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:06.077125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:06.086991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1032/2082] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:06.122512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd8109-cd33-46b5-8249-304ce1bb5d2a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:06.126458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:06.127101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:06.127365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:06.127667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:06.129533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:06.189363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:06.190878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:06.200117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1051/2083] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:41:06.363793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:06.365633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:06.380137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81f2c7-646c-4d6c-8a5c-e485de324596 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:06.386250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:06.387240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:06.387608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:06.388003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] PATH_INFO: `/v3/projects/20ad123c93e544f6904809e803beff23` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:06.389283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ad123c93e544f6904809e803beff23)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:06.391542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:06.444810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ad123c93e544f6904809e803beff23', 'request_id': 'req-89a8737d-420e-43f9-b06a-4e46a939ffcd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.451217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ad123c93e544f6904809e803beff23', 'request_id': 'req-89a8737d-420e-43f9-b06a-4e46a939ffcd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.464163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ad123c93e544f6904809e803beff23', 'request_id': 'req-89a8737d-420e-43f9-b06a-4e46a939ffcd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.477902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] The token cache is being invalidate because project 20ad123c93e544f6904809e803beff23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:06.477902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.477902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.477902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1033/2084] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:06 2022] DELETE /identity/v3/projects/20ad123c93e544f6904809e803beff23 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:06.481287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:06.492759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7fad-3d27-4589-83ec-5c0644cffc82 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:06.554581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:06.555500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:06.555781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:06.556057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] PATH_INFO: `/v3/users/5d98d62f2b78437e901e97a0de9076f5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:06.557266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d98d62f2b78437e901e97a0de9076f5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:06.559265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:06.610032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d98d62f2b78437e901e97a0de9076f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.626368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d98d62f2b78437e901e97a0de9076f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.627608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d98d62f2b78437e901e97a0de9076f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.635745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d98d62f2b78437e901e97a0de9076f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.647961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a3a4015-2013-492e-b915-acf0963a5624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d98d62f2b78437e901e97a0de9076f5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:06.656834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1052/2085] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:06 2022] DELETE /identity/v3/users/5d98d62f2b78437e901e97a0de9076f5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:06.955541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:06.957189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:06.971163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8737d-420e-43f9-b06a-4e46a939ffcd admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.026870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.027883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.028216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.028490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] PATH_INFO: `/v3/projects/efd2db3313fa4d54abc3a28172aec397` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.029832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd2db3313fa4d54abc3a28172aec397)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.032026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.080379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd2db3313fa4d54abc3a28172aec397', 'request_id': 'req-5c342613-9388-49c0-9c02-ff55b6c50a71'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:07.086629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd2db3313fa4d54abc3a28172aec397', 'request_id': 'req-5c342613-9388-49c0-9c02-ff55b6c50a71'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:07.094907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd2db3313fa4d54abc3a28172aec397', 'request_id': 'req-5c342613-9388-49c0-9c02-ff55b6c50a71'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:07.105155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] The token cache is being invalidate because project efd2db3313fa4d54abc3a28172aec397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:07.105437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:07.106091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c342613-9388-49c0-9c02-ff55b6c50a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:07.107642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1034/2086] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:06 2022] DELETE /identity/v3/projects/efd2db3313fa4d54abc3a28172aec397 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:07.112485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19c2a-35b6-495c-ba43-0741f9515d0c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.113457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19c2a-35b6-495c-ba43-0741f9515d0c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.113457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19c2a-35b6-495c-ba43-0741f9515d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.131412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1df19c2a-35b6-495c-ba43-0741f9515d0c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:07.132596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1df19c2a-35b6-495c-ba43-0741f9515d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:07.189532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1053/2087] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:07.197719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aa222-ec87-42f6-9d8b-b736fa78b565 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.198008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aa222-ec87-42f6-9d8b-b736fa78b565 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.198350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aa222-ec87-42f6-9d8b-b736fa78b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.216852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9e0aa222-ec87-42f6-9d8b-b736fa78b565 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:07.218098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9e0aa222-ec87-42f6-9d8b-b736fa78b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:07.227117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1035/2088] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:07.231614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19c2a-35b6-495c-ba43-0741f9515d0c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.241828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19c2a-35b6-495c-ba43-0741f9515d0c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.247307 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.247958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.248238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.248511 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.249237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:07.249542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.251224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.271585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1054/2089] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:07.276219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aa222-ec87-42f6-9d8b-b736fa78b565 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.288202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aa222-ec87-42f6-9d8b-b736fa78b565 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.294222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cfbd5-3a62-4366-91cd-a919a20b04b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.294878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cfbd5-3a62-4366-91cd-a919a20b04b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.295470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cfbd5-3a62-4366-91cd-a919a20b04b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.295715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cfbd5-3a62-4366-91cd-a919a20b04b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.296443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cfbd5-3a62-4366-91cd-a919a20b04b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.298406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cfbd5-3a62-4366-91cd-a919a20b04b6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.327531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1036/2090] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:07 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:07.331848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.342562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9de7-2c16-41d5-920b-c2e4cc0da82c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.407218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16a7e9-eb9e-4800-98f3-87e3a4f44939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.407978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16a7e9-eb9e-4800-98f3-87e3a4f44939 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.408225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16a7e9-eb9e-4800-98f3-87e3a4f44939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.408626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16a7e9-eb9e-4800-98f3-87e3a4f44939 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.409485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16a7e9-eb9e-4800-98f3-87e3a4f44939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.411475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16a7e9-eb9e-4800-98f3-87e3a4f44939 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.432019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1055/2091] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:07 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:07.436335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cfbd5-3a62-4366-91cd-a919a20b04b6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.447216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cfbd5-3a62-4366-91cd-a919a20b04b6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.452710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40211d47-34fa-4409-975b-a79983aa781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.453300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211d47-34fa-4409-975b-a79983aa781b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.453610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211d47-34fa-4409-975b-a79983aa781b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.453948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211d47-34fa-4409-975b-a79983aa781b admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.454703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40211d47-34fa-4409-975b-a79983aa781b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.456412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40211d47-34fa-4409-975b-a79983aa781b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.466657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1037/2092] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:07.470758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16a7e9-eb9e-4800-98f3-87e3a4f44939 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.480895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16a7e9-eb9e-4800-98f3-87e3a4f44939 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.485942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa33fd-ce1d-488a-bd21-ea175307cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.486628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa33fd-ce1d-488a-bd21-ea175307cf5f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.486908 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa33fd-ce1d-488a-bd21-ea175307cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.487181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa33fd-ce1d-488a-bd21-ea175307cf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.487977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa33fd-ce1d-488a-bd21-ea175307cf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.489581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa33fd-ce1d-488a-bd21-ea175307cf5f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.499747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1056/2093] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:07.504059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40211d47-34fa-4409-975b-a79983aa781b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.514735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40211d47-34fa-4409-975b-a79983aa781b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.520272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ca22-3c67-4a7f-88c8-eeae5541e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.521149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ca22-3c67-4a7f-88c8-eeae5541e154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.521425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ca22-3c67-4a7f-88c8-eeae5541e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.521721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ca22-3c67-4a7f-88c8-eeae5541e154 admin admin] PATH_INFO: `/v3/projects/15f82c5b9fb0483b97f859c9bb2642e7/users/23c8af96730546d182bb0079f22c7be2/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.538402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0ca22-3c67-4a7f-88c8-eeae5541e154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f82c5b9fb0483b97f859c9bb2642e7, user_id=23c8af96730546d182bb0079f22c7be2, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.541075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0ca22-3c67-4a7f-88c8-eeae5541e154 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.556411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1038/2094] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:07 2022] PUT /identity/v3/projects/15f82c5b9fb0483b97f859c9bb2642e7/users/23c8af96730546d182bb0079f22c7be2/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:07.566622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e2ffe-75e4-46c0-870d-a4eda8477068 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.566902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e2ffe-75e4-46c0-870d-a4eda8477068 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.567178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e2ffe-75e4-46c0-870d-a4eda8477068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.593766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-245e2ffe-75e4-46c0-870d-a4eda8477068 None None] MFA Rules not processed for user `23c8af96730546d182bb0079f22c7be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:07.594957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-245e2ffe-75e4-46c0-870d-a4eda8477068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:07.674583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1057/2095] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:07.682798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ca22-3c67-4a7f-88c8-eeae5541e154 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.758606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ca22-3c67-4a7f-88c8-eeae5541e154 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.764038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270cb3b-c90b-4ca2-b4f0-aec85f366b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.764936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270cb3b-c90b-4ca2-b4f0-aec85f366b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.765223 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270cb3b-c90b-4ca2-b4f0-aec85f366b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.765490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270cb3b-c90b-4ca2-b4f0-aec85f366b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.766206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270cb3b-c90b-4ca2-b4f0-aec85f366b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.768083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270cb3b-c90b-4ca2-b4f0-aec85f366b9a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.795700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1039/2096] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:07 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:07.799402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e2ffe-75e4-46c0-870d-a4eda8477068 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.810527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e2ffe-75e4-46c0-870d-a4eda8477068 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.865337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a95b06-680e-4dac-a1df-bae6bab4d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.866056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a95b06-680e-4dac-a1df-bae6bab4d46c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.866393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a95b06-680e-4dac-a1df-bae6bab4d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.866677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a95b06-680e-4dac-a1df-bae6bab4d46c admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.867335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a95b06-680e-4dac-a1df-bae6bab4d46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.869261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a95b06-680e-4dac-a1df-bae6bab4d46c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.891132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1058/2097] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:07 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:07.894926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270cb3b-c90b-4ca2-b4f0-aec85f366b9a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.904827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270cb3b-c90b-4ca2-b4f0-aec85f366b9a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.909770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a92c-de3f-478f-a445-4a501993b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.910432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a92c-de3f-478f-a445-4a501993b75b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.910710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a92c-de3f-478f-a445-4a501993b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.911027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a92c-de3f-478f-a445-4a501993b75b admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.911779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0a92c-de3f-478f-a445-4a501993b75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.913361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0a92c-de3f-478f-a445-4a501993b75b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.928837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1040/2098] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:07.930062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a95b06-680e-4dac-a1df-bae6bab4d46c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.940748 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a95b06-680e-4dac-a1df-bae6bab4d46c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:07.946040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7affdc4-c53c-4cee-85b7-2bd845019441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:07.946930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7affdc4-c53c-4cee-85b7-2bd845019441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:07.947214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7affdc4-c53c-4cee-85b7-2bd845019441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:07.947475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7affdc4-c53c-4cee-85b7-2bd845019441 admin admin] PATH_INFO: `/v3/projects/21b684949dc84c40b6f0e88ad21b6909/users/71348182110b4df5a8175ec0b84ef52c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:07.963275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7affdc4-c53c-4cee-85b7-2bd845019441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b684949dc84c40b6f0e88ad21b6909, user_id=71348182110b4df5a8175ec0b84ef52c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:07.965993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7affdc4-c53c-4cee-85b7-2bd845019441 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:07.979868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1059/2099] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:07 2022] PUT /identity/v3/projects/21b684949dc84c40b6f0e88ad21b6909/users/71348182110b4df5a8175ec0b84ef52c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:07.983833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a92c-de3f-478f-a445-4a501993b75b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:07.993926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a92c-de3f-478f-a445-4a501993b75b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:08.056788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f66b4-3087-4978-8aac-1efdf856b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:08.057810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f66b4-3087-4978-8aac-1efdf856b7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:08.058731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f66b4-3087-4978-8aac-1efdf856b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:08.059028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f66b4-3087-4978-8aac-1efdf856b7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:08.060102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f66b4-3087-4978-8aac-1efdf856b7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:08.062898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f66b4-3087-4978-8aac-1efdf856b7d2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:08.074710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1041/2100] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:08.078992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7affdc4-c53c-4cee-85b7-2bd845019441 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:08.089471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7affdc4-c53c-4cee-85b7-2bd845019441 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:08.095277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:08.096207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:08.096483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:08.096749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] PATH_INFO: `/v3/projects/21b684949dc84c40b6f0e88ad21b6909/users/71348182110b4df5a8175ec0b84ef52c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:08.098801 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b684949dc84c40b6f0e88ad21b6909, user_id=71348182110b4df5a8175ec0b84ef52c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:08.101481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:08.114032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1060/2101] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:08 2022] PUT /identity/v3/projects/21b684949dc84c40b6f0e88ad21b6909/users/71348182110b4df5a8175ec0b84ef52c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:08.124918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4442c-2ab1-473b-a8a7-716a1270c758 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:08.125204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4442c-2ab1-473b-a8a7-716a1270c758 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:08.125478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4442c-2ab1-473b-a8a7-716a1270c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:08.155877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d2d4442c-2ab1-473b-a8a7-716a1270c758 None None] MFA Rules not processed for user `71348182110b4df5a8175ec0b84ef52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:08.157085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d2d4442c-2ab1-473b-a8a7-716a1270c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:08.228555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1042/2102] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:08.240049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:08.242104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:08.302990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c010bd9-7854-4a0f-ba91-d2dabacf107e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:08.307524 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:08.308178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:08.308453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:08.308719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:08.319891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:08.321367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:08.332470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1061/2103] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:08.410585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4442c-2ab1-473b-a8a7-716a1270c758 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:08.421311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4442c-2ab1-473b-a8a7-716a1270c758 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:08.425436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:08.426118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:08.426395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:08.426661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:08.483569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:08.484990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:08.494065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1043/2104] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:10.001724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:10.002818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:10.008031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:10.010021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:10.024164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87ee00-6188-4e44-bf86-f4aebab69419 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:10.028543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b304b-0a43-4325-8fdb-71360d7c7eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:10.029322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b304b-0a43-4325-8fdb-71360d7c7eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:10.029728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b304b-0a43-4325-8fdb-71360d7c7eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:10.030122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b304b-0a43-4325-8fdb-71360d7c7eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:10.032209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-425b304b-0a43-4325-8fdb-71360d7c7eb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:10.093069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c932e3a-86a9-472a-95f2-2ce0075f2ed6 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:10.099071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b304b-0a43-4325-8fdb-71360d7c7eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:10.099459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:10.100724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b304b-0a43-4325-8fdb-71360d7c7eb4 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:10.100873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:10.101021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:10.101292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] PATH_INFO: `/v3/users/46b30f7e3dc24d41b485f7926a578231` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:10.102780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b30f7e3dc24d41b485f7926a578231)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:10.104761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:10.109910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1044/2105] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:41:10.155332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b30f7e3dc24d41b485f7926a578231'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.168226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b30f7e3dc24d41b485f7926a578231'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.168942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b30f7e3dc24d41b485f7926a578231'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.176260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b30f7e3dc24d41b485f7926a578231'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.184201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b30f7e3dc24d41b485f7926a578231'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.190569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1062/2106] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:09 2022] DELETE /identity/v3/users/46b30f7e3dc24d41b485f7926a578231 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:10.195126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7916d-1ee0-46be-b2fc-49a9d803ab43 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:10.195419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7916d-1ee0-46be-b2fc-49a9d803ab43 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:10.195691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7916d-1ee0-46be-b2fc-49a9d803ab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:10.213442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8af7916d-1ee0-46be-b2fc-49a9d803ab43 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:10.214637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8af7916d-1ee0-46be-b2fc-49a9d803ab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:10.276658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1045/2107] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:10.284488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:10.285731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:10.351670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba264694-5d63-49b7-a671-b4cf823047ee admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:10.356375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:10.357070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:10.357349 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:10.357666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:10.369985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:10.371706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:10.383144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1063/2108] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:10.686451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7916d-1ee0-46be-b2fc-49a9d803ab43 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:10.687901 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8af7916d-1ee0-46be-b2fc-49a9d803ab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:10.745086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7916d-1ee0-46be-b2fc-49a9d803ab43 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:10.748846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:10.749497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:10.749811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:10.750211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:10.751970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:10.779997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:10.781507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:10.814876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7909d8-74db-4f1b-851f-c67154e2c8d4 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:10.825754 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:10.826487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:10.826999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:10.827464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:10.827878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] PATH_INFO: `/v3/projects/5ecdb5fa0c9840ac8168f8d7f6eeae0c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:10.827989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:10.830130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecdb5fa0c9840ac8168f8d7f6eeae0c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:10.834657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:10.840679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1046/2109] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:10.915817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecdb5fa0c9840ac8168f8d7f6eeae0c', 'request_id': 'req-2c54bac1-c458-4e80-b674-e2367760fbb2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.929291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecdb5fa0c9840ac8168f8d7f6eeae0c', 'request_id': 'req-2c54bac1-c458-4e80-b674-e2367760fbb2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.940899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecdb5fa0c9840ac8168f8d7f6eeae0c', 'request_id': 'req-2c54bac1-c458-4e80-b674-e2367760fbb2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.955800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] The token cache is being invalidate because project 5ecdb5fa0c9840ac8168f8d7f6eeae0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:10.957062 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.957426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:10.959437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1064/2110] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:10 2022] DELETE /identity/v3/projects/5ecdb5fa0c9840ac8168f8d7f6eeae0c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:10.963506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:10.979640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6009d5-4dd9-4362-80bc-60befdd267d7 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:11.078729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:11.080875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:11.081204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:11.081515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] PATH_INFO: `/v3/users/69b726f537dd489db457db594a890a82` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:11.083832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b726f537dd489db457db594a890a82)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:11.086433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:11.222495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b726f537dd489db457db594a890a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.252435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b726f537dd489db457db594a890a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.253414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b726f537dd489db457db594a890a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.254189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b726f537dd489db457db594a890a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.262371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b726f537dd489db457db594a890a82'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.284080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1047/2111] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:10 2022] DELETE /identity/v3/users/69b726f537dd489db457db594a890a82 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:11.815120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:11.816709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:11.839693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54bac1-c458-4e80-b674-e2367760fbb2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:11.864406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:11.866127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:11.914684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:11.915641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:11.915922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:11.916194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] PATH_INFO: `/v3/users/565fbf46701f48b383d24614caf7b576` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:11.917538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565fbf46701f48b383d24614caf7b576)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:11.919489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:11.947341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141d14-1ddf-4d52-9e9a-4b7cab192a16 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:11.952508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:11.953558 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:11.953927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:11.954266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] PATH_INFO: `/v3/projects/7d358d0836414be5acae522aba228b5d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:11.955583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d358d0836414be5acae522aba228b5d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:11.957598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:11.967063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565fbf46701f48b383d24614caf7b576'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.978321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565fbf46701f48b383d24614caf7b576'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.978990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565fbf46701f48b383d24614caf7b576'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.987089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565fbf46701f48b383d24614caf7b576'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:11.994277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565fbf46701f48b383d24614caf7b576'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.000393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1065/2112] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:11 2022] DELETE /identity/v3/users/565fbf46701f48b383d24614caf7b576 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:12.009724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d358d0836414be5acae522aba228b5d', 'request_id': 'req-5b2a675c-1062-4485-b1f6-933e55c8d107'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.015853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d358d0836414be5acae522aba228b5d', 'request_id': 'req-5b2a675c-1062-4485-b1f6-933e55c8d107'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.025083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d358d0836414be5acae522aba228b5d', 'request_id': 'req-5b2a675c-1062-4485-b1f6-933e55c8d107'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.038872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] The token cache is being invalidate because project 7d358d0836414be5acae522aba228b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:12.039164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.039833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.041623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1048/2113] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:11 2022] DELETE /identity/v3/projects/7d358d0836414be5acae522aba228b5d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:12.047896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.047896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:12.127103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea701-6de2-4f9d-97b4-f421aca88068 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.133968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.134560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.135261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.135554 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] PATH_INFO: `/v3/users/cbdcef8a482348d59f4cb8e1c47a5e25` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.136782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbdcef8a482348d59f4cb8e1c47a5e25)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.138742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.183760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.186687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:12.207023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbdcef8a482348d59f4cb8e1c47a5e25'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.221810 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbdcef8a482348d59f4cb8e1c47a5e25'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.222942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbdcef8a482348d59f4cb8e1c47a5e25'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.230663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbdcef8a482348d59f4cb8e1c47a5e25'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.240501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24dd0cd0-9eb5-43ee-a94b-2a872569d7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbdcef8a482348d59f4cb8e1c47a5e25'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.247038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1066/2114] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:12 2022] DELETE /identity/v3/users/cbdcef8a482348d59f4cb8e1c47a5e25 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:12.271924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a675c-1062-4485-b1f6-933e55c8d107 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.332522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.333720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.334049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.334324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] PATH_INFO: `/v3/projects/954fb79bc14043c5a136989ab363e7fd` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.336349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954fb79bc14043c5a136989ab363e7fd)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.338777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.397958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954fb79bc14043c5a136989ab363e7fd', 'request_id': 'req-5c059290-45ad-4f11-b4b1-efda30239ab5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.404073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954fb79bc14043c5a136989ab363e7fd', 'request_id': 'req-5c059290-45ad-4f11-b4b1-efda30239ab5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.412287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954fb79bc14043c5a136989ab363e7fd', 'request_id': 'req-5c059290-45ad-4f11-b4b1-efda30239ab5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.427541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] The token cache is being invalidate because project 954fb79bc14043c5a136989ab363e7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:12.427836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.428492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c059290-45ad-4f11-b4b1-efda30239ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.430440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1049/2115] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:12 2022] DELETE /identity/v3/projects/954fb79bc14043c5a136989ab363e7fd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:12.435486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2099-eec3-4a0c-bf7a-59fcb6c79a4a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.435779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2099-eec3-4a0c-bf7a-59fcb6c79a4a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.436055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2099-eec3-4a0c-bf7a-59fcb6c79a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.454799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-68db2099-eec3-4a0c-bf7a-59fcb6c79a4a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:12.456039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-68db2099-eec3-4a0c-bf7a-59fcb6c79a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:12.533664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1067/2116] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:12.542575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261559-3ec3-4b82-b877-5ece3a43e5ca None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.542856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261559-3ec3-4b82-b877-5ece3a43e5ca None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.543438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261559-3ec3-4b82-b877-5ece3a43e5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.566050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-eb261559-3ec3-4b82-b877-5ece3a43e5ca None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:12.566050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-eb261559-3ec3-4b82-b877-5ece3a43e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:12.566537 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2099-eec3-4a0c-bf7a-59fcb6c79a4a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.570051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-68db2099-eec3-4a0c-bf7a-59fcb6c79a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:12.575059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1050/2117] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:12.579005 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb261559-3ec3-4b82-b877-5ece3a43e5ca None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.584126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2099-eec3-4a0c-bf7a-59fcb6c79a4a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.591579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.592653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.593508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.593508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] PATH_INFO: `/v3/projects/0a5be63c85b849718674b9aaf87ebd4e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.594879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5be63c85b849718674b9aaf87ebd4e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.596995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.609132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb261559-3ec3-4b82-b877-5ece3a43e5ca None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.618496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.619352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.619630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.619902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.620634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:12.620938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.622710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.638634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1051/2118] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:12.639647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.645268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5be63c85b849718674b9aaf87ebd4e', 'request_id': 'req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.650806 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f6dd8-ea3a-493b-a12c-c683bd1f009f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.654018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5be63c85b849718674b9aaf87ebd4e', 'request_id': 'req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.664027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5be63c85b849718674b9aaf87ebd4e', 'request_id': 'req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.675818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] The token cache is being invalidate because project 0a5be63c85b849718674b9aaf87ebd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:12.676137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.676777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:12.678423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1068/2119] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:12 2022] DELETE /identity/v3/projects/0a5be63c85b849718674b9aaf87ebd4e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:12.718722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e1bf-fe42-4baa-b910-6c3babc1ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.719404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e1bf-fe42-4baa-b910-6c3babc1ba8b admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.719680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e1bf-fe42-4baa-b910-6c3babc1ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.719927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e1bf-fe42-4baa-b910-6c3babc1ba8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.720663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0e1bf-fe42-4baa-b910-6c3babc1ba8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.722718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0e1bf-fe42-4baa-b910-6c3babc1ba8b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.756953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1052/2120] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:12 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:12.757813 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.759541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:12.775917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f76ec-c23a-48c0-ab58-5dcc2d4c55d2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.836020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297843d-446f-4fea-8603-3cd678e86ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.836660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297843d-446f-4fea-8603-3cd678e86ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.836871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297843d-446f-4fea-8603-3cd678e86ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.837143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297843d-446f-4fea-8603-3cd678e86ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.837888 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297843d-446f-4fea-8603-3cd678e86ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.839852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297843d-446f-4fea-8603-3cd678e86ce9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.863347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1069/2121] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:12 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:12.867769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e1bf-fe42-4baa-b910-6c3babc1ba8b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.883636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e1bf-fe42-4baa-b910-6c3babc1ba8b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.888423 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990d14-58c5-41b0-b38f-d027b35d46b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.889092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990d14-58c5-41b0-b38f-d027b35d46b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.889371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990d14-58c5-41b0-b38f-d027b35d46b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.889680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990d14-58c5-41b0-b38f-d027b35d46b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.890413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba990d14-58c5-41b0-b38f-d027b35d46b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.892092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba990d14-58c5-41b0-b38f-d027b35d46b2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.902767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1053/2122] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:12.906919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297843d-446f-4fea-8603-3cd678e86ce9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.916762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297843d-446f-4fea-8603-3cd678e86ce9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.921641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8c8a2-5013-4b5b-a859-e04ead9dcf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.922301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8c8a2-5013-4b5b-a859-e04ead9dcf60 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.922580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8c8a2-5013-4b5b-a859-e04ead9dcf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.922858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8c8a2-5013-4b5b-a859-e04ead9dcf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.923609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8c8a2-5013-4b5b-a859-e04ead9dcf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.925265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8c8a2-5013-4b5b-a859-e04ead9dcf60 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.935264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1070/2123] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:12.939487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990d14-58c5-41b0-b38f-d027b35d46b2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:12.949845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990d14-58c5-41b0-b38f-d027b35d46b2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:12.954636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5481a-e797-41f6-8622-1344d6a0b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:12.955524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5481a-e797-41f6-8622-1344d6a0b3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.955803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5481a-e797-41f6-8622-1344d6a0b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:12.956146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5481a-e797-41f6-8622-1344d6a0b3cf admin admin] PATH_INFO: `/v3/projects/d85125dd321643d78c3647c696756982/users/6d5323e35cb94e54bb2f7709a71b8eea/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:12.970766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5481a-e797-41f6-8622-1344d6a0b3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85125dd321643d78c3647c696756982, user_id=6d5323e35cb94e54bb2f7709a71b8eea, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:12.973458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5481a-e797-41f6-8622-1344d6a0b3cf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:12.988349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1054/2124] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:12 2022] PUT /identity/v3/projects/d85125dd321643d78c3647c696756982/users/6d5323e35cb94e54bb2f7709a71b8eea/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:12.999355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028cec-60fe-4d71-bc90-2c40cef3d47e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:12.999788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028cec-60fe-4d71-bc90-2c40cef3d47e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.000072 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61028cec-60fe-4d71-bc90-2c40cef3d47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.027971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-61028cec-60fe-4d71-bc90-2c40cef3d47e None None] MFA Rules not processed for user `6d5323e35cb94e54bb2f7709a71b8eea`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:13.029204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-61028cec-60fe-4d71-bc90-2c40cef3d47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:13.092949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1071/2125] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:13.097612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5481a-e797-41f6-8622-1344d6a0b3cf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:13.160485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5481a-e797-41f6-8622-1344d6a0b3cf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:13.165658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9af4-197a-4405-acd7-8833cceed38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:13.166321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9af4-197a-4405-acd7-8833cceed38e admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.166605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9af4-197a-4405-acd7-8833cceed38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.166874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9af4-197a-4405-acd7-8833cceed38e admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.167576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b9af4-197a-4405-acd7-8833cceed38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:13.169496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b9af4-197a-4405-acd7-8833cceed38e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:13.196305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1055/2126] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:13 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:13.200466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61028cec-60fe-4d71-bc90-2c40cef3d47e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:13.211585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61028cec-60fe-4d71-bc90-2c40cef3d47e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:13.269487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acf5d1-cec1-41ba-ad2e-23a43daed408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:13.270177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acf5d1-cec1-41ba-ad2e-23a43daed408 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.270462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acf5d1-cec1-41ba-ad2e-23a43daed408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.270739 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acf5d1-cec1-41ba-ad2e-23a43daed408 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.271424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acf5d1-cec1-41ba-ad2e-23a43daed408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:13.273359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acf5d1-cec1-41ba-ad2e-23a43daed408 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:13.295140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1072/2127] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:13 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:13.298989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9af4-197a-4405-acd7-8833cceed38e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:13.309224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9af4-197a-4405-acd7-8833cceed38e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:13.314121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddeac88-d787-46d0-948a-009c0573c19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:13.314779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeac88-d787-46d0-948a-009c0573c19c admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.315060 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeac88-d787-46d0-948a-009c0573c19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.315355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeac88-d787-46d0-948a-009c0573c19c admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.316106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddeac88-d787-46d0-948a-009c0573c19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:13.317742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddeac88-d787-46d0-948a-009c0573c19c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:13.328219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1056/2128] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:13.332220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acf5d1-cec1-41ba-ad2e-23a43daed408 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:13.342579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acf5d1-cec1-41ba-ad2e-23a43daed408 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:13.349154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aa1df-eebe-4ba0-a089-150d06237fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:13.350012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aa1df-eebe-4ba0-a089-150d06237fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.350292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aa1df-eebe-4ba0-a089-150d06237fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.350585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aa1df-eebe-4ba0-a089-150d06237fb3 admin admin] PATH_INFO: `/v3/projects/30ee601e04a741f19fafd224deba6b67/users/e9d433cd442e4785810ce524c7b6ca9c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.366168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aa1df-eebe-4ba0-a089-150d06237fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ee601e04a741f19fafd224deba6b67, user_id=e9d433cd442e4785810ce524c7b6ca9c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:13.369657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aa1df-eebe-4ba0-a089-150d06237fb3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:13.382827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1073/2129] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:13 2022] PUT /identity/v3/projects/30ee601e04a741f19fafd224deba6b67/users/e9d433cd442e4785810ce524c7b6ca9c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:13.386879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddeac88-d787-46d0-948a-009c0573c19c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:13.397034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddeac88-d787-46d0-948a-009c0573c19c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:13.452270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b8581-c94e-4777-8a6f-041a981ce51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:13.452967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b8581-c94e-4777-8a6f-041a981ce51a admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.453268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b8581-c94e-4777-8a6f-041a981ce51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.453540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b8581-c94e-4777-8a6f-041a981ce51a admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.454410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b8581-c94e-4777-8a6f-041a981ce51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:13.456010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b8581-c94e-4777-8a6f-041a981ce51a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:13.466347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1057/2130] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:13.470611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aa1df-eebe-4ba0-a089-150d06237fb3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:13.481510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aa1df-eebe-4ba0-a089-150d06237fb3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:13.486871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:13.487830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.488107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.488383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] PATH_INFO: `/v3/projects/30ee601e04a741f19fafd224deba6b67/users/e9d433cd442e4785810ce524c7b6ca9c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.490444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ee601e04a741f19fafd224deba6b67, user_id=e9d433cd442e4785810ce524c7b6ca9c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:13.493117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:13.504533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1074/2131] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:13 2022] PUT /identity/v3/projects/30ee601e04a741f19fafd224deba6b67/users/e9d433cd442e4785810ce524c7b6ca9c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:13.519899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0776-9ab7-4f81-865b-150f9079e64b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.520191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0776-9ab7-4f81-865b-150f9079e64b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.520452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0776-9ab7-4f81-865b-150f9079e64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.547718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6f7c0776-9ab7-4f81-865b-150f9079e64b None None] MFA Rules not processed for user `e9d433cd442e4785810ce524c7b6ca9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:13.548918 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6f7c0776-9ab7-4f81-865b-150f9079e64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:13.619617 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1058/2132] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:13.630920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:13.632751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:13.694208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845da53-5c59-4b80-b7e1-e2e66641e5b3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:13.698720 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52610f48-709d-4ad8-89b2-5691b3d93a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:13.699364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610f48-709d-4ad8-89b2-5691b3d93a4e service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.699636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610f48-709d-4ad8-89b2-5691b3d93a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.699903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610f48-709d-4ad8-89b2-5691b3d93a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.709240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52610f48-709d-4ad8-89b2-5691b3d93a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:13.710710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52610f48-709d-4ad8-89b2-5691b3d93a4e service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:13.720096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1075/2133] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:13.782778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0776-9ab7-4f81-865b-150f9079e64b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:13.854282 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0776-9ab7-4f81-865b-150f9079e64b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:13.862403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:13.863279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.863554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.863822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] PATH_INFO: `/v3/users/6d5323e35cb94e54bb2f7709a71b8eea` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.865158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5323e35cb94e54bb2f7709a71b8eea)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:13.867135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:13.917509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5323e35cb94e54bb2f7709a71b8eea'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:13.930032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5323e35cb94e54bb2f7709a71b8eea'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:13.930793 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5323e35cb94e54bb2f7709a71b8eea'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:13.931486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5323e35cb94e54bb2f7709a71b8eea'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:13.938439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5323e35cb94e54bb2f7709a71b8eea'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:13.952802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1059/2134] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:13 2022] DELETE /identity/v3/users/6d5323e35cb94e54bb2f7709a71b8eea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:13.957340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861d49-f322-4a9f-b994-7c3c396b6a9f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:13.957872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861d49-f322-4a9f-b994-7c3c396b6a9f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:13.957965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861d49-f322-4a9f-b994-7c3c396b6a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:13.975693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-73861d49-f322-4a9f-b994-7c3c396b6a9f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:13.976949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-73861d49-f322-4a9f-b994-7c3c396b6a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:14.033289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1076/2135] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:14.043345 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:14.045322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:14.105985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588072b-b4b0-40df-a2bf-4e18a28ba428 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:14.110066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3da7de-7dba-4599-8f66-950ffc8fcdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:14.110721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da7de-7dba-4599-8f66-950ffc8fcdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:14.111002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da7de-7dba-4599-8f66-950ffc8fcdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:14.111256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da7de-7dba-4599-8f66-950ffc8fcdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:14.120625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3da7de-7dba-4599-8f66-950ffc8fcdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:14.122091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3da7de-7dba-4599-8f66-950ffc8fcdb2 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:14.131785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1060/2136] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:14.461139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73861d49-f322-4a9f-b994-7c3c396b6a9f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:14.462976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-73861d49-f322-4a9f-b994-7c3c396b6a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:14.480079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73861d49-f322-4a9f-b994-7c3c396b6a9f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:14.485760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:14.486634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:14.486914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:14.487207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] PATH_INFO: `/v3/projects/d85125dd321643d78c3647c696756982` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:14.488439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85125dd321643d78c3647c696756982)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:14.490499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:14.536695 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85125dd321643d78c3647c696756982', 'request_id': 'req-ea32df88-00ca-488f-9b3c-093d0aa508b0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.543870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85125dd321643d78c3647c696756982', 'request_id': 'req-ea32df88-00ca-488f-9b3c-093d0aa508b0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.556899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85125dd321643d78c3647c696756982', 'request_id': 'req-ea32df88-00ca-488f-9b3c-093d0aa508b0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.570896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] The token cache is being invalidate because project d85125dd321643d78c3647c696756982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:14.570896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.571425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ea32df88-00ca-488f-9b3c-093d0aa508b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.573098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1077/2137] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:14 2022] DELETE /identity/v3/projects/d85125dd321643d78c3647c696756982 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:14.576922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3da7de-7dba-4599-8f66-950ffc8fcdb2 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:14.586934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3da7de-7dba-4599-8f66-950ffc8fcdb2 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:14.647754 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:14.648834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:14.649195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:14.649601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] PATH_INFO: `/v3/users/e9d433cd442e4785810ce524c7b6ca9c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:14.650949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d433cd442e4785810ce524c7b6ca9c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:14.653152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:14.708898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d433cd442e4785810ce524c7b6ca9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.720463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d433cd442e4785810ce524c7b6ca9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.721165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d433cd442e4785810ce524c7b6ca9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.721837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d433cd442e4785810ce524c7b6ca9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.728678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d433cd442e4785810ce524c7b6ca9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:14.742898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1061/2138] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:14 2022] DELETE /identity/v3/users/e9d433cd442e4785810ce524c7b6ca9c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:15.057208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61868-e248-45f5-9ac5-619c64bc88e1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.057780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61868-e248-45f5-9ac5-619c64bc88e1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.057780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61868-e248-45f5-9ac5-619c64bc88e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.079271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b7e61868-e248-45f5-9ac5-619c64bc88e1 None None] MFA Rules not processed for user `4a557548cbc94c33a1d99d694d6b57c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:15.080967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b7e61868-e248-45f5-9ac5-619c64bc88e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:15.095991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.097577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:15.150794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1078/2139] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:15.168994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714377-8d6c-40e0-ae31-30ee593113fc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.173915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.174838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.175118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.175391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] PATH_INFO: `/v3/projects/30ee601e04a741f19fafd224deba6b67` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.176567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ee601e04a741f19fafd224deba6b67)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.179219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.231137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ee601e04a741f19fafd224deba6b67', 'request_id': 'req-1e9e841f-20fb-4e56-a571-382b874be481'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.238134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ee601e04a741f19fafd224deba6b67', 'request_id': 'req-1e9e841f-20fb-4e56-a571-382b874be481'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.245880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ee601e04a741f19fafd224deba6b67', 'request_id': 'req-1e9e841f-20fb-4e56-a571-382b874be481'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.257747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] The token cache is being invalidate because project 30ee601e04a741f19fafd224deba6b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:15.258038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.258688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1e9e841f-20fb-4e56-a571-382b874be481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.260555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1062/2140] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:15 2022] DELETE /identity/v3/projects/30ee601e04a741f19fafd224deba6b67 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:15.265958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6726d-9138-492b-b8ed-0f71e56d3746 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.266266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6726d-9138-492b-b8ed-0f71e56d3746 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.266549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6726d-9138-492b-b8ed-0f71e56d3746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.285966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d2e6726d-9138-492b-b8ed-0f71e56d3746 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:15.287171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d2e6726d-9138-492b-b8ed-0f71e56d3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:15.346737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1079/2141] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:15.353779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3014029-00c9-44d4-8bb8-437faae41477 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.354106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3014029-00c9-44d4-8bb8-437faae41477 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.354439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3014029-00c9-44d4-8bb8-437faae41477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.373267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d3014029-00c9-44d4-8bb8-437faae41477 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:15.374506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d3014029-00c9-44d4-8bb8-437faae41477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:15.383486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1063/2142] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:15.387780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6726d-9138-492b-b8ed-0f71e56d3746 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.398293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6726d-9138-492b-b8ed-0f71e56d3746 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.403017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.403686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.403937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.404417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.405148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:15.405456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.407106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.425961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1080/2143] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:15.427674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3014029-00c9-44d4-8bb8-437faae41477 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.439546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3014029-00c9-44d4-8bb8-437faae41477 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.448790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dadd31-9e55-48a7-837d-0f614ddca7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.449567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dadd31-9e55-48a7-837d-0f614ddca7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.449941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dadd31-9e55-48a7-837d-0f614ddca7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.450594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dadd31-9e55-48a7-837d-0f614ddca7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.451373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dadd31-9e55-48a7-837d-0f614ddca7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.453362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dadd31-9e55-48a7-837d-0f614ddca7d0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.489831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.495368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1064/2144] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:15.500315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15837fca-8cf2-4b0f-a38c-96d04e7c8dc4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.562513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199dfd-9ad5-4b5b-b648-d54931fc9367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.563286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199dfd-9ad5-4b5b-b648-d54931fc9367 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.563286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199dfd-9ad5-4b5b-b648-d54931fc9367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.563515 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199dfd-9ad5-4b5b-b648-d54931fc9367 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.564210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c199dfd-9ad5-4b5b-b648-d54931fc9367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.566257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c199dfd-9ad5-4b5b-b648-d54931fc9367 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.587183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1081/2145] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:15.592130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dadd31-9e55-48a7-837d-0f614ddca7d0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.602117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dadd31-9e55-48a7-837d-0f614ddca7d0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.606821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77fb9-956c-456e-bbbd-af7994ad68d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.607556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77fb9-956c-456e-bbbd-af7994ad68d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.607838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77fb9-956c-456e-bbbd-af7994ad68d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.608112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77fb9-956c-456e-bbbd-af7994ad68d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.608838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece77fb9-956c-456e-bbbd-af7994ad68d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.610527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece77fb9-956c-456e-bbbd-af7994ad68d2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.624746 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1065/2146] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:15.625837 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199dfd-9ad5-4b5b-b648-d54931fc9367 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.635749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199dfd-9ad5-4b5b-b648-d54931fc9367 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.640723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613388c3-4bfd-4f05-b089-8c291caf202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.641436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613388c3-4bfd-4f05-b089-8c291caf202d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.641827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613388c3-4bfd-4f05-b089-8c291caf202d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.642170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613388c3-4bfd-4f05-b089-8c291caf202d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.643011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613388c3-4bfd-4f05-b089-8c291caf202d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.644678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613388c3-4bfd-4f05-b089-8c291caf202d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.655585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1082/2147] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:15.662982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77fb9-956c-456e-bbbd-af7994ad68d2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.675332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77fb9-956c-456e-bbbd-af7994ad68d2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.680261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.681093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.681371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.681715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] PATH_INFO: `/v3/projects/8360c41602194b6b82d71dbfb8de2ee4/users/390de33a40404ca8a8ba9db9ae05e6e7/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.697072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8360c41602194b6b82d71dbfb8de2ee4, user_id=390de33a40404ca8a8ba9db9ae05e6e7, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.700020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.717586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1066/2148] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:15 2022] PUT /identity/v3/projects/8360c41602194b6b82d71dbfb8de2ee4/users/390de33a40404ca8a8ba9db9ae05e6e7/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:15.728303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477cc22-6056-4b2e-a9f4-1116cbf5efb5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.728597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477cc22-6056-4b2e-a9f4-1116cbf5efb5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.729054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477cc22-6056-4b2e-a9f4-1116cbf5efb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.767712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.769591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:15.779970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d477cc22-6056-4b2e-a9f4-1116cbf5efb5 None None] MFA Rules not processed for user `390de33a40404ca8a8ba9db9ae05e6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:15.781298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d477cc22-6056-4b2e-a9f4-1116cbf5efb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:15.885140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1ef05-a994-444f-827e-c12c54ec6b6f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.894197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.895102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.895412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.895730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] PATH_INFO: `/v3/users/1433d216975745a19e5aa31cc52007b4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.897013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1433d216975745a19e5aa31cc52007b4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.899401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.911728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1083/2149] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:15.914090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477cc22-6056-4b2e-a9f4-1116cbf5efb5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.927105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477cc22-6056-4b2e-a9f4-1116cbf5efb5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:15.933457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a792dc-515c-4f7b-a83d-30e09425e381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:15.934220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a792dc-515c-4f7b-a83d-30e09425e381 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.934485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a792dc-515c-4f7b-a83d-30e09425e381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.934760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a792dc-515c-4f7b-a83d-30e09425e381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:15.935450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a792dc-515c-4f7b-a83d-30e09425e381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:15.937467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a792dc-515c-4f7b-a83d-30e09425e381 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:15.957260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1433d216975745a19e5aa31cc52007b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.970243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1084/2150] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:15.971768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a792dc-515c-4f7b-a83d-30e09425e381 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:15.971983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1433d216975745a19e5aa31cc52007b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.972738 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1433d216975745a19e5aa31cc52007b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.973359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1433d216975745a19e5aa31cc52007b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.980455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-83e636eb-631c-4933-b965-ec45df65c240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1433d216975745a19e5aa31cc52007b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:15.993891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1067/2151] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:15 2022] DELETE /identity/v3/users/1433d216975745a19e5aa31cc52007b4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:15.998686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940c8e0-064a-4a6f-8b8a-cfa63c69e09a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:15.998686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940c8e0-064a-4a6f-8b8a-cfa63c69e09a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:15.998896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940c8e0-064a-4a6f-8b8a-cfa63c69e09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.015862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a940c8e0-064a-4a6f-8b8a-cfa63c69e09a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:16.017064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a940c8e0-064a-4a6f-8b8a-cfa63c69e09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:16.059035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a792dc-515c-4f7b-a83d-30e09425e381 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.082112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1068/2152] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:16.092625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940c8e0-064a-4a6f-8b8a-cfa63c69e09a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:16.094947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a940c8e0-064a-4a6f-8b8a-cfa63c69e09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:16.131444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.132240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.133879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.134445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.135399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.137402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.171074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1085/2153] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:15 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:16.175802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:16.178102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:16.182868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940c8e0-064a-4a6f-8b8a-cfa63c69e09a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.186706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b4f68-eea6-4244-ab75-591fa1c429d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.187349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b4f68-eea6-4244-ab75-591fa1c429d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.187781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b4f68-eea6-4244-ab75-591fa1c429d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.188192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b4f68-eea6-4244-ab75-591fa1c429d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.192649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d93a1a-9946-4cc4-b2fb-1be8a17b39b3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.201200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b4f68-eea6-4244-ab75-591fa1c429d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.201449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635ffa1-e96f-437b-b836-8e88881a790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.202196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ffa1-e96f-437b-b836-8e88881a790f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.202481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ffa1-e96f-437b-b836-8e88881a790f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.202808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ffa1-e96f-437b-b836-8e88881a790f admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.203526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635ffa1-e96f-437b-b836-8e88881a790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.204078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b4f68-eea6-4244-ab75-591fa1c429d1 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.205468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635ffa1-e96f-437b-b836-8e88881a790f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.217849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1069/2154] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:41:16.221923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1086/2155] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:16.222820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b4f68-eea6-4244-ab75-591fa1c429d1 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:16.233216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b4f68-eea6-4244-ab75-591fa1c429d1 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.239731 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557c89f-ae5f-41c8-ac70-e40b02e9a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.241637 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557c89f-ae5f-41c8-ac70-e40b02e9a3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.241947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557c89f-ae5f-41c8-ac70-e40b02e9a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.242257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557c89f-ae5f-41c8-ac70-e40b02e9a3b0 admin admin] PATH_INFO: `/v3/projects/07f24154ee054c9e9b043ff10cb8bcc8/users/2c7846ce9842492d9a6a83a17c78cd59/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.264087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557c89f-ae5f-41c8-ac70-e40b02e9a3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f24154ee054c9e9b043ff10cb8bcc8, user_id=2c7846ce9842492d9a6a83a17c78cd59, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.268235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557c89f-ae5f-41c8-ac70-e40b02e9a3b0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.295160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1070/2156] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:16 2022] PUT /identity/v3/projects/07f24154ee054c9e9b043ff10cb8bcc8/users/2c7846ce9842492d9a6a83a17c78cd59/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:16.299642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635ffa1-e96f-437b-b836-8e88881a790f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:16.313484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635ffa1-e96f-437b-b836-8e88881a790f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.413383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58406967-38ef-4640-b175-ff135c4960b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.414344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406967-38ef-4640-b175-ff135c4960b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.414627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406967-38ef-4640-b175-ff135c4960b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.416343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406967-38ef-4640-b175-ff135c4960b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.417281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58406967-38ef-4640-b175-ff135c4960b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.423798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58406967-38ef-4640-b175-ff135c4960b1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.445149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1087/2157] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:16.446424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557c89f-ae5f-41c8-ac70-e40b02e9a3b0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:16.460713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557c89f-ae5f-41c8-ac70-e40b02e9a3b0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.469782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.470694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.470977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.471251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] PATH_INFO: `/v3/projects/07f24154ee054c9e9b043ff10cb8bcc8/users/2c7846ce9842492d9a6a83a17c78cd59/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.473715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f24154ee054c9e9b043ff10cb8bcc8, user_id=2c7846ce9842492d9a6a83a17c78cd59, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.476404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.500291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1071/2158] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:16 2022] PUT /identity/v3/projects/07f24154ee054c9e9b043ff10cb8bcc8/users/2c7846ce9842492d9a6a83a17c78cd59/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:16.511898 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79bbb3-a8c5-4491-a1cb-e5e94925e0ae None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.512183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79bbb3-a8c5-4491-a1cb-e5e94925e0ae None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.512459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79bbb3-a8c5-4491-a1cb-e5e94925e0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.540869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:16.543370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:16.545168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6b79bbb3-a8c5-4491-a1cb-e5e94925e0ae None None] MFA Rules not processed for user `2c7846ce9842492d9a6a83a17c78cd59`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:16.546765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6b79bbb3-a8c5-4491-a1cb-e5e94925e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:16.626664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ad48-ea68-4d48-b794-8c03064f7f9b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.632007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.633014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.633175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.633997 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] PATH_INFO: `/v3/projects/2e0cf8be458042299ea8aeab2d5cd643` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.635489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0cf8be458042299ea8aeab2d5cd643)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.637414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.647072 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1088/2159] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:16.666220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79bbb3-a8c5-4491-a1cb-e5e94925e0ae None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:16.668036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6b79bbb3-a8c5-4491-a1cb-e5e94925e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:16.695993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0cf8be458042299ea8aeab2d5cd643', 'request_id': 'req-b8a9898b-3ce1-446d-930d-7cecd5167401'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.702019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0cf8be458042299ea8aeab2d5cd643', 'request_id': 'req-b8a9898b-3ce1-446d-930d-7cecd5167401'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.709979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0cf8be458042299ea8aeab2d5cd643', 'request_id': 'req-b8a9898b-3ce1-446d-930d-7cecd5167401'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.721038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] The token cache is being invalidate because project 2e0cf8be458042299ea8aeab2d5cd643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:16.721330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.722006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.723747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1072/2160] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:16 2022] DELETE /identity/v3/projects/2e0cf8be458042299ea8aeab2d5cd643 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:16.727564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:16.729094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:16.742693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79bbb3-a8c5-4491-a1cb-e5e94925e0ae None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.790282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.790932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.791205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.791473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.793229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:16.793435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9898b-3ce1-446d-930d-7cecd5167401 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:16.798392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:16.799266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:16.799546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:16.799873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] PATH_INFO: `/v3/users/74f25e7ee62a4d9c932253e22962948d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:16.801101 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f25e7ee62a4d9c932253e22962948d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.803056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.852055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f25e7ee62a4d9c932253e22962948d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.864297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:16.866144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:16.866682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f25e7ee62a4d9c932253e22962948d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.867414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f25e7ee62a4d9c932253e22962948d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.868025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f25e7ee62a4d9c932253e22962948d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.874830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2ab5b31f-3038-4491-934b-df980ce8a576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f25e7ee62a4d9c932253e22962948d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:16.879685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1089/2161] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:41:16.898929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1073/2162] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:16 2022] DELETE /identity/v3/users/74f25e7ee62a4d9c932253e22962948d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:17.014220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.016449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.035755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7084ee2-f069-4c15-9d6f-56a41ca48ec6 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.117539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.118482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.118763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.119032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] PATH_INFO: `/v3/users/2d1c20085ae549fda1a3024c445540a0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.120276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1c20085ae549fda1a3024c445540a0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.129676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.220849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1c20085ae549fda1a3024c445540a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.233660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1c20085ae549fda1a3024c445540a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.234601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1c20085ae549fda1a3024c445540a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.242513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1c20085ae549fda1a3024c445540a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.255995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1c20085ae549fda1a3024c445540a0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.270581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1090/2163] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:17 2022] DELETE /identity/v3/users/2d1c20085ae549fda1a3024c445540a0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:17.275157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97679e-fe3b-419c-88f9-eb605ef917a5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.278036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97679e-fe3b-419c-88f9-eb605ef917a5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.284015 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97679e-fe3b-419c-88f9-eb605ef917a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.304020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.305654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.314765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-af97679e-fe3b-419c-88f9-eb605ef917a5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:17.316568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-af97679e-fe3b-419c-88f9-eb605ef917a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.384605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1074/2164] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:17.385256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97679e-fe3b-419c-88f9-eb605ef917a5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.385928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975444c-407a-4ace-8bd9-39a09e72efa0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.386559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-af97679e-fe3b-419c-88f9-eb605ef917a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.398110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.399015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.399348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.399808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] PATH_INFO: `/v3/projects/776e99cc72034e529c2ea71673b542f8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.401024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776e99cc72034e529c2ea71673b542f8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.403545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.450730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776e99cc72034e529c2ea71673b542f8', 'request_id': 'req-9fcf34bf-7e7d-4098-a9c9-148770f54184'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.452493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97679e-fe3b-419c-88f9-eb605ef917a5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.456961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776e99cc72034e529c2ea71673b542f8', 'request_id': 'req-9fcf34bf-7e7d-4098-a9c9-148770f54184'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.467749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776e99cc72034e529c2ea71673b542f8', 'request_id': 'req-9fcf34bf-7e7d-4098-a9c9-148770f54184'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.478891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] The token cache is being invalidate because project 776e99cc72034e529c2ea71673b542f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:17.479170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.479819 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.481690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1091/2165] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:17 2022] DELETE /identity/v3/projects/776e99cc72034e529c2ea71673b542f8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:17.482520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.483855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.513711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1adb1-4dd0-421f-ae67-5ad06c0b17d0 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7846ce9842492d9a6a83a17c78cd59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07f24154ee054c9e9b043ff10cb8bcc8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.514384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1adb1-4dd0-421f-ae67-5ad06c0b17d0 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.514848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1adb1-4dd0-421f-ae67-5ad06c0b17d0 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.515120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1adb1-4dd0-421f-ae67-5ad06c0b17d0 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.516000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1adb1-4dd0-421f-ae67-5ad06c0b17d0 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:17.516596 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1adb1-4dd0-421f-ae67-5ad06c0b17d0 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.518468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1adb1-4dd0-421f-ae67-5ad06c0b17d0 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.534052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1075/2166] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:17.534052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff5743-0c35-48aa-b3d1-f9cee2eea3e7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.534052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff5743-0c35-48aa-b3d1-f9cee2eea3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.534052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff5743-0c35-48aa-b3d1-f9cee2eea3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.553517 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-51ff5743-0c35-48aa-b3d1-f9cee2eea3e7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:17.554932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-51ff5743-0c35-48aa-b3d1-f9cee2eea3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.565763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf34bf-7e7d-4098-a9c9-148770f54184 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.571365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fd2ff-aea5-4f2d-b0c8-303cc2b8ac38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.572155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd2ff-aea5-4f2d-b0c8-303cc2b8ac38 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.572441 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd2ff-aea5-4f2d-b0c8-303cc2b8ac38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.572852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd2ff-aea5-4f2d-b0c8-303cc2b8ac38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.575109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e82fd2ff-aea5-4f2d-b0c8-303cc2b8ac38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.640674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1076/2167] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:17.640674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff5743-0c35-48aa-b3d1-f9cee2eea3e7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.640674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-51ff5743-0c35-48aa-b3d1-f9cee2eea3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.657655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff5743-0c35-48aa-b3d1-f9cee2eea3e7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.665455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98feeff-0adc-444b-b6c0-925259a8c8ce tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7846ce9842492d9a6a83a17c78cd59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07f24154ee054c9e9b043ff10cb8bcc8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.666163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98feeff-0adc-444b-b6c0-925259a8c8ce tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.666427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98feeff-0adc-444b-b6c0-925259a8c8ce tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.666697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98feeff-0adc-444b-b6c0-925259a8c8ce tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.667388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98feeff-0adc-444b-b6c0-925259a8c8ce tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.670293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98feeff-0adc-444b-b6c0-925259a8c8ce tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.670953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fd2ff-aea5-4f2d-b0c8-303cc2b8ac38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.672728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fd2ff-aea5-4f2d-b0c8-303cc2b8ac38 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.686049 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1092/2168] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:17.688055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4408d-c402-4fc0-91c6-4b56ea5a37ca None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.688411 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4408d-c402-4fc0-91c6-4b56ea5a37ca None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.688882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4408d-c402-4fc0-91c6-4b56ea5a37ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.714931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7ac4408d-c402-4fc0-91c6-4b56ea5a37ca None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:17.716482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7ac4408d-c402-4fc0-91c6-4b56ea5a37ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.719141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1077/2169] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:17 2022] POST /identity/v3/projects => generated 354 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:17.723270 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98feeff-0adc-444b-b6c0-925259a8c8ce tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.807277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98feeff-0adc-444b-b6c0-925259a8c8ce tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.811982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7846ce9842492d9a6a83a17c78cd59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07f24154ee054c9e9b043ff10cb8bcc8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.812803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.813092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.813370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.814157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:17.814445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.816819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.826954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1093/2170] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:17.828661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4408d-c402-4fc0-91c6-4b56ea5a37ca None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.830724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7ac4408d-c402-4fc0-91c6-4b56ea5a37ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:17.832239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1078/2171] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:41:17.833315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.846271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4408d-c402-4fc0-91c6-4b56ea5a37ca None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.859032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.860723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.861417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.861944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] PATH_INFO: `/v3/users/23c8af96730546d182bb0079f22c7be2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.863469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c8af96730546d182bb0079f22c7be2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.867277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.871957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e45c56-dd7c-4abb-94a4-1ca3221bdf84 tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.886811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.887401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.887957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.888391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.890239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:17.890625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.894539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.918356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1079/2172] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:17.918356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:17.948087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd08cbb-3fad-48ce-84ff-508470e6457d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:17.949403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c8af96730546d182bb0079f22c7be2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.965700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7846ce9842492d9a6a83a17c78cd59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07f24154ee054c9e9b043ff10cb8bcc8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:17.967122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:17.968845 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:17.969431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] PATH_INFO: `/v3/projects/4303f97fcfae40e3898207583a07d3bb` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:17.971756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4303f97fcfae40e3898207583a07d3bb)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:17.973465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c8af96730546d182bb0079f22c7be2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.973777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:17.974770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c8af96730546d182bb0079f22c7be2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:17.991590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c8af96730546d182bb0079f22c7be2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.004850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c8af96730546d182bb0079f22c7be2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.012899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1094/2173] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:17 2022] DELETE /identity/v3/users/23c8af96730546d182bb0079f22c7be2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:18.013913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.016237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.029253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4303f97fcfae40e3898207583a07d3bb', 'request_id': 'req-2167520f-1662-4a76-8c3b-4c4097f7d0be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.036516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4303f97fcfae40e3898207583a07d3bb', 'request_id': 'req-2167520f-1662-4a76-8c3b-4c4097f7d0be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.048026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4303f97fcfae40e3898207583a07d3bb', 'request_id': 'req-2167520f-1662-4a76-8c3b-4c4097f7d0be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.067982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] The token cache is being invalidate because project 4303f97fcfae40e3898207583a07d3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:18.068284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.069790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2167520f-1662-4a76-8c3b-4c4097f7d0be tempest-VolumeQuotaClassesTest-30923842 tempest-VolumeQuotaClassesTest-30923842-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.076934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1080/2174] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:17 2022] DELETE /identity/v3/projects/4303f97fcfae40e3898207583a07d3bb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:18.086788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016af24-4643-4add-a93d-1d71ad336aea None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.087257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016af24-4643-4add-a93d-1d71ad336aea None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.087638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016af24-4643-4add-a93d-1d71ad336aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.130962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8016af24-4643-4add-a93d-1d71ad336aea None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:18.133357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895de38-00ba-4c65-bdd9-83833a30c57a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.135399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8016af24-4643-4add-a93d-1d71ad336aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.241152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1081/2175] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:18.243071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016af24-4643-4add-a93d-1d71ad336aea None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.244787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8016af24-4643-4add-a93d-1d71ad336aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.268112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016af24-4643-4add-a93d-1d71ad336aea None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.270161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.271109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.271109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.271414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.272098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.272299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.273165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.273526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.273877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] PATH_INFO: `/v3/projects/8c15b1c8c2604ea48fd6f3319ebceadc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.275390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c15b1c8c2604ea48fd6f3319ebceadc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.275516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.277271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.327060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1095/2176] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:18 2022] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:18.328233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.331934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.337498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c15b1c8c2604ea48fd6f3319ebceadc', 'request_id': 'req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.343627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c15b1c8c2604ea48fd6f3319ebceadc', 'request_id': 'req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.355265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c15b1c8c2604ea48fd6f3319ebceadc', 'request_id': 'req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.377813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] The token cache is being invalidate because project 8c15b1c8c2604ea48fd6f3319ebceadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:18.378161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.382842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.384713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1082/2177] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:18 2022] DELETE /identity/v3/projects/8c15b1c8c2604ea48fd6f3319ebceadc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:18.385798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.387355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.400518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef739a38-92c6-4001-9c03-dc5b637769a8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.404248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.404892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.405201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.405437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.407398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.453757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7b931-e4b3-4e3e-84dc-89519ae64dc6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.474464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.476150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.485931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1096/2178] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:18.486891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.488227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.499717 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fda4b-9f5e-4a79-9e35-460698233b23 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.506735 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.507603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.507878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.508291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] PATH_INFO: `/v3/users/390de33a40404ca8a8ba9db9ae05e6e7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.509521 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=390de33a40404ca8a8ba9db9ae05e6e7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.511888 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.512468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.513140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.513424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.513741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.514436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.516352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.543363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1083/2179] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:18 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:18.543363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.545788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.562077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873c65-0cd3-4d0e-bcda-9d0bd9a3b470 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.564880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390de33a40404ca8a8ba9db9ae05e6e7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.569157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.571150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.571294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.571520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] PATH_INFO: `/v3/users/c0155e92eee04b3d80eb83bacb0d31f7` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.574042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0155e92eee04b3d80eb83bacb0d31f7)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.576895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.577240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390de33a40404ca8a8ba9db9ae05e6e7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.579246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390de33a40404ca8a8ba9db9ae05e6e7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.588139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390de33a40404ca8a8ba9db9ae05e6e7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.600002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390de33a40404ca8a8ba9db9ae05e6e7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.608297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1097/2180] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:18 2022] DELETE /identity/v3/users/390de33a40404ca8a8ba9db9ae05e6e7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:18.609736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.611828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.636740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0155e92eee04b3d80eb83bacb0d31f7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.650715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0155e92eee04b3d80eb83bacb0d31f7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.651685 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0155e92eee04b3d80eb83bacb0d31f7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.652320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0155e92eee04b3d80eb83bacb0d31f7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.661081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-72a5f7b0-5704-4911-9e96-95d75966a85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0155e92eee04b3d80eb83bacb0d31f7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:18.675999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1084/2181] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:18 2022] DELETE /identity/v3/users/c0155e92eee04b3d80eb83bacb0d31f7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:18.679997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44485a-8d2c-4a59-85b7-76b472748cfa admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.680248 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d39d-7ee6-47ad-8a12-3d18d8379154 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.680693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d39d-7ee6-47ad-8a12-3d18d8379154 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.681490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d39d-7ee6-47ad-8a12-3d18d8379154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.706990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-32c5d39d-7ee6-47ad-8a12-3d18d8379154 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:18.709143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-32c5d39d-7ee6-47ad-8a12-3d18d8379154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.742552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.743793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.743793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.743793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.744954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.747623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.764412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1098/2182] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:18.766045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.770683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.792250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e94ba-d3c0-4267-909d-2565fd3c0364 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.800970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.802051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.802332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.802640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.803544 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.805228 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.814640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1085/2183] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:18.819651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1099/2184] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:18.824831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5d39d-7ee6-47ad-8a12-3d18d8379154 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.827003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:18.828881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:18.836098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5d39d-7ee6-47ad-8a12-3d18d8379154 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.842249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217ba09-d299-43b2-83a7-365215daa2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:18.843517 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ba09-d299-43b2-83a7-365215daa2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.843874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ba09-d299-43b2-83a7-365215daa2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.844218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ba09-d299-43b2-83a7-365215daa2a8 admin admin] PATH_INFO: `/v3/projects/2b33094605c64d2b9bc333529f8f1d67/users/2e65d33e75d04cdb8b056ec997170d7f/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.868027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ba09-d299-43b2-83a7-365215daa2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b33094605c64d2b9bc333529f8f1d67, user_id=2e65d33e75d04cdb8b056ec997170d7f, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:18.872383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ba09-d299-43b2-83a7-365215daa2a8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:18.895267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1086/2185] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:18 2022] PUT /identity/v3/projects/2b33094605c64d2b9bc333529f8f1d67/users/2e65d33e75d04cdb8b056ec997170d7f/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:18.908383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca09e9-e94c-4320-8208-f4bb9e8c4180 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:18.908743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca09e9-e94c-4320-8208-f4bb9e8c4180 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:18.909110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca09e9-e94c-4320-8208-f4bb9e8c4180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:18.910489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d12e77-f830-4c84-a02d-725232e429ac admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:18.946772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e4ca09e9-e94c-4320-8208-f4bb9e8c4180 None None] MFA Rules not processed for user `2e65d33e75d04cdb8b056ec997170d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:18.952839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e4ca09e9-e94c-4320-8208-f4bb9e8c4180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.001845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.002519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.002851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.003123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.049762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1087/2186] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:19.055633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca09e9-e94c-4320-8208-f4bb9e8c4180 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.139873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.149381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.164057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1100/2187] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:19.165187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.166696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.175887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca09e9-e94c-4320-8208-f4bb9e8c4180 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.180667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.181343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.181650 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.181925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.182676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.183915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5ea9-fe97-4bcc-907c-52c77d9ec1ed service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.184600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.189263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.190496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.190821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.191101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] PATH_INFO: `/v3/projects/15f82c5b9fb0483b97f859c9bb2642e7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.192395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f82c5b9fb0483b97f859c9bb2642e7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.196198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.224470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1088/2188] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:19 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:19.225840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.228517 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.286637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f82c5b9fb0483b97f859c9bb2642e7', 'request_id': 'req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.294369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f82c5b9fb0483b97f859c9bb2642e7', 'request_id': 'req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.306723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f82c5b9fb0483b97f859c9bb2642e7', 'request_id': 'req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.319056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5bf31-209d-4fdc-9b01-6c2e7094e1b8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.326106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] The token cache is being invalidate because project 15f82c5b9fb0483b97f859c9bb2642e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:19.326415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.327053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.329052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1101/2189] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:19 2022] DELETE /identity/v3/projects/15f82c5b9fb0483b97f859c9bb2642e7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:19.330522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.332199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.402492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.404065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.404065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.404065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] PATH_INFO: `/v3/projects/340d9f78c2684129aaf1a66edcdcaf5a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.405123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=340d9f78c2684129aaf1a66edcdcaf5a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.407803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.438658 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8dcef-a67f-4051-9a7a-54aa4e5ac50d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.444689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.445686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.446167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.446636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.447519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.449949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.480774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340d9f78c2684129aaf1a66edcdcaf5a', 'request_id': 'req-c053651b-c44d-49d5-b181-f601160aae42'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.491176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340d9f78c2684129aaf1a66edcdcaf5a', 'request_id': 'req-c053651b-c44d-49d5-b181-f601160aae42'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.495475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1102/2190] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:19 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:19.497269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.500861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.501872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340d9f78c2684129aaf1a66edcdcaf5a', 'request_id': 'req-c053651b-c44d-49d5-b181-f601160aae42'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.514287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] The token cache is being invalidate because project 340d9f78c2684129aaf1a66edcdcaf5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:19.514584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.515242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.517133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1089/2191] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:19 2022] DELETE /identity/v3/projects/340d9f78c2684129aaf1a66edcdcaf5a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:19.517916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.519345 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.519954 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a782b-f377-4c0f-85fa-ea90f6e52521 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.596429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053651b-c44d-49d5-b181-f601160aae42 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.600852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.601985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.602428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.602707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] PATH_INFO: `/v3/users/71348182110b4df5a8175ec0b84ef52c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.603974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71348182110b4df5a8175ec0b84ef52c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.604318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.605471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.605999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.606473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.606578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.607503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.609892 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.622550 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1090/2192] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:19.623452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.626697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.640390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fef7e-d35d-4f3f-b29b-be0e5071635f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.646609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.647714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.647860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.648174 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] PATH_INFO: `/v3/users/96b48326d5144a97855fac7acb8fabad` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.649582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b48326d5144a97855fac7acb8fabad)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.651726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.666209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71348182110b4df5a8175ec0b84ef52c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.681496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71348182110b4df5a8175ec0b84ef52c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.682528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71348182110b4df5a8175ec0b84ef52c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.689907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71348182110b4df5a8175ec0b84ef52c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.698364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71348182110b4df5a8175ec0b84ef52c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.704638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1103/2193] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:19 2022] DELETE /identity/v3/users/71348182110b4df5a8175ec0b84ef52c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:19.705924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.707328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.707615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b48326d5144a97855fac7acb8fabad'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.720190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b48326d5144a97855fac7acb8fabad'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.720919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b48326d5144a97855fac7acb8fabad'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.721650 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b48326d5144a97855fac7acb8fabad'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.728681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b48326d5144a97855fac7acb8fabad'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.747984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1091/2194] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:19 2022] DELETE /identity/v3/users/96b48326d5144a97855fac7acb8fabad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:19.749209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.758380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.780849 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e9fa6-9766-4c95-a155-622959495f91 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.856019 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e458fb-20bd-4a63-8fba-b114957e9bce admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:19.857820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.858964 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.859456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.859786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] PATH_INFO: `/v3/projects/2b80ea8a893c4f12912226372361ddce/users/82585c1856ca47c184b9bf2d42c7407e/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.861366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:19.863231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:19.863544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:19.863821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] PATH_INFO: `/v3/projects/8360c41602194b6b82d71dbfb8de2ee4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:19.865951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8360c41602194b6b82d71dbfb8de2ee4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.870058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.882571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b80ea8a893c4f12912226372361ddce, user_id=82585c1856ca47c184b9bf2d42c7407e, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:19.885497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:19.909936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1104/2195] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:19 2022] PUT /identity/v3/projects/2b80ea8a893c4f12912226372361ddce/users/82585c1856ca47c184b9bf2d42c7407e/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:19.913838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.915814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:19.951066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8360c41602194b6b82d71dbfb8de2ee4', 'request_id': 'req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.960931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8360c41602194b6b82d71dbfb8de2ee4', 'request_id': 'req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.970435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8360c41602194b6b82d71dbfb8de2ee4', 'request_id': 'req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.981891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] The token cache is being invalidate because project 8360c41602194b6b82d71dbfb8de2ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:19.982272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.982895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:19.984835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1092/2196] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:19 2022] DELETE /identity/v3/projects/8360c41602194b6b82d71dbfb8de2ee4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:19.989877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:19.991302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.003959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed1333-0566-40d3-bdea-8de59c2cab45 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.058751 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34a41e-d9a1-4431-ac0e-2f732a1f2278 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.064113 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.065404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.065885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.066292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] PATH_INFO: `/v3/users/2c7846ce9842492d9a6a83a17c78cd59` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.067451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.068137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7846ce9842492d9a6a83a17c78cd59)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.068428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.068842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.069251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.070181 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.070353 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.072481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.085316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1105/2197] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:20.090040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.092368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.107728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadcd1e-33e6-4b0a-b070-04c16399770b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.115597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.118782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.118782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.118782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] PATH_INFO: `/v3/projects/2b80ea8a893c4f12912226372361ddce/users/82585c1856ca47c184b9bf2d42c7407e/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.120684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b80ea8a893c4f12912226372361ddce, user_id=82585c1856ca47c184b9bf2d42c7407e, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.123400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.135306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1106/2198] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:20 2022] PUT /identity/v3/projects/2b80ea8a893c4f12912226372361ddce/users/82585c1856ca47c184b9bf2d42c7407e/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:20.136702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.154094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.156197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7846ce9842492d9a6a83a17c78cd59'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.171854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7846ce9842492d9a6a83a17c78cd59'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.172876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7846ce9842492d9a6a83a17c78cd59'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.173709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7846ce9842492d9a6a83a17c78cd59'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.184239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7846ce9842492d9a6a83a17c78cd59'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.201879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1093/2199] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:19 2022] DELETE /identity/v3/users/2c7846ce9842492d9a6a83a17c78cd59 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:20.202640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.204168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.243088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f495f-aca5-40a3-96d5-9f2936a5f8e8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.276050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623e6a4-fbc1-4e67-8c0f-25c3ce4579bb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.281662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.282706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.283277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.283553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] PATH_INFO: `/v3/projects/19ceff83a740463cafbf9c1938578d46` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.284799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ceff83a740463cafbf9c1938578d46)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.286767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.307220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.308477 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.308909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.309175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] PATH_INFO: `/v3/projects/21b684949dc84c40b6f0e88ad21b6909` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.310378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b684949dc84c40b6f0e88ad21b6909)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.312299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.373029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b684949dc84c40b6f0e88ad21b6909', 'request_id': 'req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.380929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b684949dc84c40b6f0e88ad21b6909', 'request_id': 'req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.384213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ceff83a740463cafbf9c1938578d46', 'request_id': 'req-c0ef70ab-38a9-4961-9bf1-8f62c384079d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.393837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ceff83a740463cafbf9c1938578d46', 'request_id': 'req-c0ef70ab-38a9-4961-9bf1-8f62c384079d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.394036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b684949dc84c40b6f0e88ad21b6909', 'request_id': 'req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.403509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ceff83a740463cafbf9c1938578d46', 'request_id': 'req-c0ef70ab-38a9-4961-9bf1-8f62c384079d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.407836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] The token cache is being invalidate because project 21b684949dc84c40b6f0e88ad21b6909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:20.408952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.410305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-903d33a0-5a9c-42f9-b888-a1a57aa0d26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.413508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1107/2200] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:20 2022] DELETE /identity/v3/projects/21b684949dc84c40b6f0e88ad21b6909 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:20.418022 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f0d17-6cc9-4fc5-8807-84df1b1cbf65 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.418311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f0d17-6cc9-4fc5-8807-84df1b1cbf65 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.418588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f0d17-6cc9-4fc5-8807-84df1b1cbf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.431193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] The token cache is being invalidate because project 19ceff83a740463cafbf9c1938578d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:20.432189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.432943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0ef70ab-38a9-4961-9bf1-8f62c384079d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.434569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1094/2201] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:20 2022] DELETE /identity/v3/projects/19ceff83a740463cafbf9c1938578d46 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:20.442654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162a1dd-8531-4bb3-9346-c50259a43b34 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.442947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162a1dd-8531-4bb3-9346-c50259a43b34 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.443226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162a1dd-8531-4bb3-9346-c50259a43b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.454832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-629f0d17-6cc9-4fc5-8807-84df1b1cbf65 None None] MFA Rules not processed for user `82585c1856ca47c184b9bf2d42c7407e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:20.456135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-629f0d17-6cc9-4fc5-8807-84df1b1cbf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.467811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5162a1dd-8531-4bb3-9346-c50259a43b34 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:20.469388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5162a1dd-8531-4bb3-9346-c50259a43b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.538884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1108/2202] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:20.539581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1095/2203] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:20.540343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db433468-b4f0-4912-b495-18e84f2e8388 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.540967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db433468-b4f0-4912-b495-18e84f2e8388 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.540967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db433468-b4f0-4912-b495-18e84f2e8388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.550753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020d7e-05c7-450f-a842-f16b52baaddc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.551037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020d7e-05c7-450f-a842-f16b52baaddc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.551311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020d7e-05c7-450f-a842-f16b52baaddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.562377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-db433468-b4f0-4912-b495-18e84f2e8388 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:20.563676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-db433468-b4f0-4912-b495-18e84f2e8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.574773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e4020d7e-05c7-450f-a842-f16b52baaddc None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:20.574995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1109/2204] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:20.575852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db433468-b4f0-4912-b495-18e84f2e8388 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.576386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e4020d7e-05c7-450f-a842-f16b52baaddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.578534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-db433468-b4f0-4912-b495-18e84f2e8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.589540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1096/2205] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:20.589540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020d7e-05c7-450f-a842-f16b52baaddc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.589540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e4020d7e-05c7-450f-a842-f16b52baaddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.599146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020d7e-05c7-450f-a842-f16b52baaddc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.604303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.605206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.605479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.605779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] PATH_INFO: `/v3/projects/07f24154ee054c9e9b043ff10cb8bcc8` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.607108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f24154ee054c9e9b043ff10cb8bcc8)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.609295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.647378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db433468-b4f0-4912-b495-18e84f2e8388 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.653231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaea204-6976-4aad-a7a3-5e9b99e318cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.653993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaea204-6976-4aad-a7a3-5e9b99e318cd service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.654205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaea204-6976-4aad-a7a3-5e9b99e318cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.654480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaea204-6976-4aad-a7a3-5e9b99e318cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.664300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaea204-6976-4aad-a7a3-5e9b99e318cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.665770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaea204-6976-4aad-a7a3-5e9b99e318cd service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.667396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f24154ee054c9e9b043ff10cb8bcc8', 'request_id': 'req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.678440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f24154ee054c9e9b043ff10cb8bcc8', 'request_id': 'req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.679161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1110/2206] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:20.680512 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f817dc-b357-42f6-ac12-fbdfdcdad863 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.680810 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f817dc-b357-42f6-ac12-fbdfdcdad863 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.681068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f817dc-b357-42f6-ac12-fbdfdcdad863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.699130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-52f817dc-b357-42f6-ac12-fbdfdcdad863 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:20.700407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-52f817dc-b357-42f6-ac12-fbdfdcdad863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.704235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f24154ee054c9e9b043ff10cb8bcc8', 'request_id': 'req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.718018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] The token cache is being invalidate because project 07f24154ee054c9e9b043ff10cb8bcc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:20.718553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.719297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.725059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1097/2207] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:20 2022] DELETE /identity/v3/projects/07f24154ee054c9e9b043ff10cb8bcc8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:20.726073 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.727504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.769605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1111/2208] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:20.777072 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f817dc-b357-42f6-ac12-fbdfdcdad863 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.778644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-52f817dc-b357-42f6-ac12-fbdfdcdad863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.790906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f817dc-b357-42f6-ac12-fbdfdcdad863 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.795605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.796469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.796742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.797009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] PATH_INFO: `/v3/users/2e65d33e75d04cdb8b056ec997170d7f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.798230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e65d33e75d04cdb8b056ec997170d7f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.800124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f9d6a-1a21-4929-bb4c-311ebeb09d6d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.800245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.806269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6b43-cc20-4668-b084-cf152a8433c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.807305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6b43-cc20-4668-b084-cf152a8433c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.807591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6b43-cc20-4668-b084-cf152a8433c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.807868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6b43-cc20-4668-b084-cf152a8433c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.808599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb6b43-cc20-4668-b084-cf152a8433c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:20.808903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb6b43-cc20-4668-b084-cf152a8433c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.810522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb6b43-cc20-4668-b084-cf152a8433c1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.822934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1098/2209] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:20.824671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b18d0-7b89-4db6-885a-c58736ebb840 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.825017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b18d0-7b89-4db6-885a-c58736ebb840 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.825302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b18d0-7b89-4db6-885a-c58736ebb840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.845584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-085b18d0-7b89-4db6-885a-c58736ebb840 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:20.846925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-085b18d0-7b89-4db6-885a-c58736ebb840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.849965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e65d33e75d04cdb8b056ec997170d7f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.862347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1099/2210] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:20.862347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b18d0-7b89-4db6-885a-c58736ebb840 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.862594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e65d33e75d04cdb8b056ec997170d7f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.862594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e65d33e75d04cdb8b056ec997170d7f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.868572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e65d33e75d04cdb8b056ec997170d7f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.871949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b18d0-7b89-4db6-885a-c58736ebb840 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.877057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a146e-1753-483d-9222-8d9b88cc6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.877781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a146e-1753-483d-9222-8d9b88cc6e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.878050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a146e-1753-483d-9222-8d9b88cc6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.878243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e65d33e75d04cdb8b056ec997170d7f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:20.878338 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a146e-1753-483d-9222-8d9b88cc6e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.879118 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a146e-1753-483d-9222-8d9b88cc6e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:20.879393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a146e-1753-483d-9222-8d9b88cc6e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.880990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a146e-1753-483d-9222-8d9b88cc6e55 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.884424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1112/2211] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:20 2022] DELETE /identity/v3/users/2e65d33e75d04cdb8b056ec997170d7f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:20.887337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.887337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.892948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1100/2212] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:20.894243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115fd6f-346b-4b4c-a6fd-d10e71d158d0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.894527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115fd6f-346b-4b4c-a6fd-d10e71d158d0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.894803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115fd6f-346b-4b4c-a6fd-d10e71d158d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.912026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7115fd6f-346b-4b4c-a6fd-d10e71d158d0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:20.913203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7115fd6f-346b-4b4c-a6fd-d10e71d158d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.948750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3abed-5195-45a1-9817-359db48d2b9e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:20.953650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:20.954302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.954581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.954850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.955555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:20.957576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:20.968206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1101/2213] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:20.969527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f374-e301-48e3-bcd3-e78b47eee6b1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:20.969842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f374-e301-48e3-bcd3-e78b47eee6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:20.970120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f374-e301-48e3-bcd3-e78b47eee6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:20.986342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1113/2214] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:20.986342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.986342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:20.988748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-94f3f374-e301-48e3-bcd3-e78b47eee6b1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:20.989975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-94f3f374-e301-48e3-bcd3-e78b47eee6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:21.047551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eac0e-6c00-4303-a6e1-182b5cf39a74 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.049153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1102/2215] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:21.050096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3f374-e301-48e3-bcd3-e78b47eee6b1 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.055577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.056270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.056549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.056820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.057505 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.059495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.061809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3f374-e301-48e3-bcd3-e78b47eee6b1 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.066484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.067132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.067411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.067680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.068403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:21.068705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.070329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.084890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1103/2216] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:21.084890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.085494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1114/2217] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:20 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:21.086326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.087925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:21.094809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e0f68-280f-4fce-b719-190f5a5fddb2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.147994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8137d-6d8d-42e8-a11a-9f326a72e9fb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.147994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac38c6-0f5c-43fb-b13f-192598476fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.147994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac38c6-0f5c-43fb-b13f-192598476fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.147994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac38c6-0f5c-43fb-b13f-192598476fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.148390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac38c6-0f5c-43fb-b13f-192598476fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.148501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081375c-8c71-4419-a0e1-8387811212a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.148748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081375c-8c71-4419-a0e1-8387811212a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.148937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081375c-8c71-4419-a0e1-8387811212a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.149213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081375c-8c71-4419-a0e1-8387811212a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.149923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081375c-8c71-4419-a0e1-8387811212a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.151830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081375c-8c71-4419-a0e1-8387811212a0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.157129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac38c6-0f5c-43fb-b13f-192598476fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.158583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac38c6-0f5c-43fb-b13f-192598476fd3 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.167917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1115/2218] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:21.172563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1104/2219] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:21 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:21.173497 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081375c-8c71-4419-a0e1-8387811212a0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.176206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac38c6-0f5c-43fb-b13f-192598476fd3 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.184559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081375c-8c71-4419-a0e1-8387811212a0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.189876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7259c7-c379-4f3b-a78d-c92c6ba01e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.190543 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac38c6-0f5c-43fb-b13f-192598476fd3 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.190797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7259c7-c379-4f3b-a78d-c92c6ba01e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.191175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7259c7-c379-4f3b-a78d-c92c6ba01e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.191536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7259c7-c379-4f3b-a78d-c92c6ba01e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.192232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7259c7-c379-4f3b-a78d-c92c6ba01e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.194953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7259c7-c379-4f3b-a78d-c92c6ba01e5c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.195774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80012236-b5fa-46e9-b45c-981854def81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.196583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80012236-b5fa-46e9-b45c-981854def81e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.196856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80012236-b5fa-46e9-b45c-981854def81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.197124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80012236-b5fa-46e9-b45c-981854def81e admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.197862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80012236-b5fa-46e9-b45c-981854def81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.200626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80012236-b5fa-46e9-b45c-981854def81e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.232985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1116/2220] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:21 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:21.233943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80012236-b5fa-46e9-b45c-981854def81e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.248042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1105/2221] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:21 2022] POST /identity/v3/users => generated 287 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:21.248042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7259c7-c379-4f3b-a78d-c92c6ba01e5c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.258705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7259c7-c379-4f3b-a78d-c92c6ba01e5c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.318664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80012236-b5fa-46e9-b45c-981854def81e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.323746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b0522-7827-4ce6-a0c9-d211fc43460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.324421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0522-7827-4ce6-a0c9-d211fc43460a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.324776 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0522-7827-4ce6-a0c9-d211fc43460a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.325191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0522-7827-4ce6-a0c9-d211fc43460a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.326108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b0522-7827-4ce6-a0c9-d211fc43460a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.327744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b0522-7827-4ce6-a0c9-d211fc43460a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.335421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b168-11ff-449b-8e63-64f93211a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.336533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b168-11ff-449b-8e63-64f93211a087 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.336533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b168-11ff-449b-8e63-64f93211a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.336787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b168-11ff-449b-8e63-64f93211a087 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.337485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072b168-11ff-449b-8e63-64f93211a087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.339633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072b168-11ff-449b-8e63-64f93211a087 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.344036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1117/2222] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:21.344861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b0522-7827-4ce6-a0c9-d211fc43460a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.356626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b0522-7827-4ce6-a0c9-d211fc43460a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.361522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7e41d-948a-441f-bf50-d030e27c5621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.362494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7e41d-948a-441f-bf50-d030e27c5621 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.362760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7e41d-948a-441f-bf50-d030e27c5621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.363043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7e41d-948a-441f-bf50-d030e27c5621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.364210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7e41d-948a-441f-bf50-d030e27c5621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.365452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7e41d-948a-441f-bf50-d030e27c5621 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.370207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1106/2223] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:21 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:21.371706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b168-11ff-449b-8e63-64f93211a087 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.377620 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1118/2224] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:21.378664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7e41d-948a-441f-bf50-d030e27c5621 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.384228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b168-11ff-449b-8e63-64f93211a087 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.390822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090b57-d95b-486d-ab18-cce305e5ad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.392593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090b57-d95b-486d-ab18-cce305e5ad5d admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.393042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090b57-d95b-486d-ab18-cce305e5ad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.393643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090b57-d95b-486d-ab18-cce305e5ad5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.394532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090b57-d95b-486d-ab18-cce305e5ad5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.394791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7e41d-948a-441f-bf50-d030e27c5621 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.396797 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090b57-d95b-486d-ab18-cce305e5ad5d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.400332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a22933-6d9a-4c05-84f6-06b8c3d31db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.401287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a22933-6d9a-4c05-84f6-06b8c3d31db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.401699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a22933-6d9a-4c05-84f6-06b8c3d31db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.402067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a22933-6d9a-4c05-84f6-06b8c3d31db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.403168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a22933-6d9a-4c05-84f6-06b8c3d31db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.405042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a22933-6d9a-4c05-84f6-06b8c3d31db5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.411341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1107/2225] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:21.412434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090b57-d95b-486d-ab18-cce305e5ad5d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.421846 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1119/2226] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:21.422827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a22933-6d9a-4c05-84f6-06b8c3d31db5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.428247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090b57-d95b-486d-ab18-cce305e5ad5d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.434646 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a185709-647d-45ab-95f7-6e75666c4f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.435531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a185709-647d-45ab-95f7-6e75666c4f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.435929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a185709-647d-45ab-95f7-6e75666c4f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.436241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a185709-647d-45ab-95f7-6e75666c4f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.437300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a185709-647d-45ab-95f7-6e75666c4f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.439435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a22933-6d9a-4c05-84f6-06b8c3d31db5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.440041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a185709-647d-45ab-95f7-6e75666c4f91 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.451200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156a5c-c6f9-44b6-b654-36be30095993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.451812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1108/2227] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:21.452645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a185709-647d-45ab-95f7-6e75666c4f91 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.454526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156a5c-c6f9-44b6-b654-36be30095993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.454803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156a5c-c6f9-44b6-b654-36be30095993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.455092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156a5c-c6f9-44b6-b654-36be30095993 admin admin] PATH_INFO: `/v3/projects/2c83ceaa75814bf4ac59287f07950e53/users/3ac29f1ebd804e75ac8dc0eac057b395/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.471588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a185709-647d-45ab-95f7-6e75666c4f91 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.479879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c0129-3093-4ddf-b340-4868a41c9806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.480909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88156a5c-c6f9-44b6-b654-36be30095993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c83ceaa75814bf4ac59287f07950e53, user_id=3ac29f1ebd804e75ac8dc0eac057b395, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.481638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c0129-3093-4ddf-b340-4868a41c9806 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.483085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c0129-3093-4ddf-b340-4868a41c9806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.483632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88156a5c-c6f9-44b6-b654-36be30095993 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.484020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c0129-3093-4ddf-b340-4868a41c9806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.486420 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c0129-3093-4ddf-b340-4868a41c9806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.489865 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c0129-3093-4ddf-b340-4868a41c9806 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.500797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1120/2228] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:21 2022] PUT /identity/v3/projects/2c83ceaa75814bf4ac59287f07950e53/users/3ac29f1ebd804e75ac8dc0eac057b395/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:21.501665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156a5c-c6f9-44b6-b654-36be30095993 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.506589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1109/2229] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:21.513698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967bc0a-01fb-45a8-b1b1-b9331f498e57 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.514080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967bc0a-01fb-45a8-b1b1-b9331f498e57 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.514448 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967bc0a-01fb-45a8-b1b1-b9331f498e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.544656 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6967bc0a-01fb-45a8-b1b1-b9331f498e57 None None] MFA Rules not processed for user `3ac29f1ebd804e75ac8dc0eac057b395`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:21.547078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6967bc0a-01fb-45a8-b1b1-b9331f498e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:21.648118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156a5c-c6f9-44b6-b654-36be30095993 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.654893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.656100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.656481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.656823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] PATH_INFO: `/v3/projects/7ee0e621e3c34c3bba8434228c575a84/users/1ae731332a684481bef208fe5bfc4866/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.661329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1110/2230] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:21.665153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967bc0a-01fb-45a8-b1b1-b9331f498e57 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.674699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967bc0a-01fb-45a8-b1b1-b9331f498e57 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.683909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61a71c-a6d3-4853-a3ab-15bd2b517815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.686256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a71c-a6d3-4853-a3ab-15bd2b517815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.686624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a71c-a6d3-4853-a3ab-15bd2b517815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.687099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a71c-a6d3-4853-a3ab-15bd2b517815 admin admin] PATH_INFO: `/v3/projects/cb991088ce1d4938a3af62c5ee21f23d/users/8d4021e1379642b284afe32bfa6e8175/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.691878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee0e621e3c34c3bba8434228c575a84, user_id=1ae731332a684481bef208fe5bfc4866, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.694665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.724044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1121/2231] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:21 2022] PUT /identity/v3/projects/7ee0e621e3c34c3bba8434228c575a84/users/1ae731332a684481bef208fe5bfc4866/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:21.725067 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61a71c-a6d3-4853-a3ab-15bd2b517815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb991088ce1d4938a3af62c5ee21f23d, user_id=8d4021e1379642b284afe32bfa6e8175, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.727406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.729460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61a71c-a6d3-4853-a3ab-15bd2b517815 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.733105 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:21.754203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1111/2232] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:21 2022] PUT /identity/v3/projects/cb991088ce1d4938a3af62c5ee21f23d/users/8d4021e1379642b284afe32bfa6e8175/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:21.755527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61a71c-a6d3-4853-a3ab-15bd2b517815 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:21.828424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09bcd0-ec4d-4d46-8d79-4540ad89702e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.839409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61a71c-a6d3-4853-a3ab-15bd2b517815 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.845968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56fc2-0e28-44ed-9013-bb8a4b622712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.847165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56fc2-0e28-44ed-9013-bb8a4b622712 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.848091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56fc2-0e28-44ed-9013-bb8a4b622712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.848375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56fc2-0e28-44ed-9013-bb8a4b622712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.849085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56fc2-0e28-44ed-9013-bb8a4b622712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.851343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56fc2-0e28-44ed-9013-bb8a4b622712 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.887105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1112/2233] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:21 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:21.888766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64fc8-3d1a-4ffc-8087-ebdbc4043731 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.889224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64fc8-3d1a-4ffc-8087-ebdbc4043731 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.889673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64fc8-3d1a-4ffc-8087-ebdbc4043731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.913505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1ae64fc8-3d1a-4ffc-8087-ebdbc4043731 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:21.919379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1ae64fc8-3d1a-4ffc-8087-ebdbc4043731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:21.923171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.924039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.924322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.924775 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] PATH_INFO: `/v3/projects/2b33094605c64d2b9bc333529f8f1d67` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.926310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b33094605c64d2b9bc333529f8f1d67)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.928196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.977395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b33094605c64d2b9bc333529f8f1d67', 'request_id': 'req-d46b17d6-ef04-415f-9799-22cc39135d5d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:21.987386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b33094605c64d2b9bc333529f8f1d67', 'request_id': 'req-d46b17d6-ef04-415f-9799-22cc39135d5d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:21.995456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b33094605c64d2b9bc333529f8f1d67', 'request_id': 'req-d46b17d6-ef04-415f-9799-22cc39135d5d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:21.998939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1113/2234] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:21.998939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4155b7-b5dd-4106-b370-f106c3063938 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.998939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4155b7-b5dd-4106-b370-f106c3063938 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.998939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4155b7-b5dd-4106-b370-f106c3063938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.015271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] The token cache is being invalidate because project 2b33094605c64d2b9bc333529f8f1d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:22.015552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.016207 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.018015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1122/2235] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:21 2022] DELETE /identity/v3/projects/2b33094605c64d2b9bc333529f8f1d67 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:22.018614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.019893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.029078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9d4155b7-b5dd-4106-b370-f106c3063938 None None] MFA Rules not processed for user `8d4021e1379642b284afe32bfa6e8175`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:22.030727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9d4155b7-b5dd-4106-b370-f106c3063938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.084396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b17d6-ef04-415f-9799-22cc39135d5d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.089033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.089741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.090048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.090325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.091148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.093297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.101010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1114/2236] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:22.101855 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4155b7-b5dd-4106-b370-f106c3063938 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.105705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9d4155b7-b5dd-4106-b370-f106c3063938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.118241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1123/2237] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:22 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:22.119148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.120786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.132632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf5273-5b26-4976-94b7-d1e9587182f8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.137368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.138351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.138643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.138922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] PATH_INFO: `/v3/users/82585c1856ca47c184b9bf2d42c7407e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.140121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82585c1856ca47c184b9bf2d42c7407e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.142100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.172763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4155b7-b5dd-4106-b370-f106c3063938 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.177156 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.177840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.178320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.178448 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.181322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.190423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82585c1856ca47c184b9bf2d42c7407e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.193064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.194525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.202375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82585c1856ca47c184b9bf2d42c7407e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.203099 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82585c1856ca47c184b9bf2d42c7407e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.205107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1115/2238] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:22.205860 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.207273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.211596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82585c1856ca47c184b9bf2d42c7407e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.219237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14483-14dc-44e4-b0ed-78b51945251c service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.220126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82585c1856ca47c184b9bf2d42c7407e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.226296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.227028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.227386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.227577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.228293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.229496 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1124/2239] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:22 2022] DELETE /identity/v3/users/82585c1856ca47c184b9bf2d42c7407e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:22.230751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.231809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.233239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.271003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1116/2240] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:22 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:22.272127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.275737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.319858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6a3a-8bb3-400d-92b2-10be899261d9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.363635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0879eb1-c1ef-4758-b497-ce0f37777c9c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.368736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f8c0-55fc-4059-b819-7d422487c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.370028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f8c0-55fc-4059-b819-7d422487c274 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.370310 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f8c0-55fc-4059-b819-7d422487c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.370585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f8c0-55fc-4059-b819-7d422487c274 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.371333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023f8c0-55fc-4059-b819-7d422487c274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.373742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023f8c0-55fc-4059-b819-7d422487c274 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.395466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357736-0309-4cbe-ab70-43c44ee60975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.396193 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357736-0309-4cbe-ab70-43c44ee60975 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.396470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357736-0309-4cbe-ab70-43c44ee60975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.396749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357736-0309-4cbe-ab70-43c44ee60975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.397498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71357736-0309-4cbe-ab70-43c44ee60975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.399132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71357736-0309-4cbe-ab70-43c44ee60975 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.409638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1117/2241] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:22 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:22.410714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1125/2242] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:22.413720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f8c0-55fc-4059-b819-7d422487c274 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.414860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357736-0309-4cbe-ab70-43c44ee60975 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.425342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357736-0309-4cbe-ab70-43c44ee60975 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.430828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756915aa-c2f7-441d-b9a0-cfa6136b1ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.432037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756915aa-c2f7-441d-b9a0-cfa6136b1ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.432308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756915aa-c2f7-441d-b9a0-cfa6136b1ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.432586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756915aa-c2f7-441d-b9a0-cfa6136b1ab7 admin admin] PATH_INFO: `/v3/projects/b28be92fc54143a49c8461b8b549dd75/users/fe9b99ff5b33409c9fcce8b5130497e1/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.438455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f8c0-55fc-4059-b819-7d422487c274 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.447234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0dcba-382f-4cc9-9307-1349c875c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.448816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0dcba-382f-4cc9-9307-1349c875c040 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.449632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0dcba-382f-4cc9-9307-1349c875c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.450373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0dcba-382f-4cc9-9307-1349c875c040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.453358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0dcba-382f-4cc9-9307-1349c875c040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.455640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756915aa-c2f7-441d-b9a0-cfa6136b1ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28be92fc54143a49c8461b8b549dd75, user_id=fe9b99ff5b33409c9fcce8b5130497e1, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.456827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0dcba-382f-4cc9-9307-1349c875c040 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.458659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756915aa-c2f7-441d-b9a0-cfa6136b1ab7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.476666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1126/2243] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:22 2022] PUT /identity/v3/projects/b28be92fc54143a49c8461b8b549dd75/users/fe9b99ff5b33409c9fcce8b5130497e1/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:22.480713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756915aa-c2f7-441d-b9a0-cfa6136b1ab7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.482589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1118/2244] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:22.487308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0dcba-382f-4cc9-9307-1349c875c040 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.511836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0dcba-382f-4cc9-9307-1349c875c040 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.552431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756915aa-c2f7-441d-b9a0-cfa6136b1ab7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.557977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b28f5-3105-48e4-8f83-dc9499614ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.558655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b28f5-3105-48e4-8f83-dc9499614ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.558931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b28f5-3105-48e4-8f83-dc9499614ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.559204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b28f5-3105-48e4-8f83-dc9499614ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.559927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b28f5-3105-48e4-8f83-dc9499614ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.561756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b28f5-3105-48e4-8f83-dc9499614ac5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.581082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1127/2245] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:22.587790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b28f5-3105-48e4-8f83-dc9499614ac5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.617983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b28f5-3105-48e4-8f83-dc9499614ac5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.623440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb81d4d-a38a-45f8-af88-6e77e8d82d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.624483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81d4d-a38a-45f8-af88-6e77e8d82d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.624770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81d4d-a38a-45f8-af88-6e77e8d82d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.625044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81d4d-a38a-45f8-af88-6e77e8d82d93 admin admin] PATH_INFO: `/v3/projects/b28be92fc54143a49c8461b8b549dd75/users/fe9b99ff5b33409c9fcce8b5130497e1/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.628071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb81d4d-a38a-45f8-af88-6e77e8d82d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28be92fc54143a49c8461b8b549dd75, user_id=fe9b99ff5b33409c9fcce8b5130497e1, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.631504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb81d4d-a38a-45f8-af88-6e77e8d82d93 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.646309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1128/2246] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:22 2022] PUT /identity/v3/projects/b28be92fc54143a49c8461b8b549dd75/users/fe9b99ff5b33409c9fcce8b5130497e1/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:22.646523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.647636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.648580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.648934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] PATH_INFO: `/v3/projects/9ee7b3fad718484bb8205ef3e1568186/users/01acb69bcb9f46b99ff10a0809763e18/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.656534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e66f6-1405-4c76-8fb5-a768c664cf36 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.656904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e66f6-1405-4c76-8fb5-a768c664cf36 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.657210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e66f6-1405-4c76-8fb5-a768c664cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.680638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee7b3fad718484bb8205ef3e1568186, user_id=01acb69bcb9f46b99ff10a0809763e18, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.683379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.707642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1119/2247] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:22 2022] PUT /identity/v3/projects/9ee7b3fad718484bb8205ef3e1568186/users/01acb69bcb9f46b99ff10a0809763e18/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:22.708609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.710529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.716222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-496e66f6-1405-4c76-8fb5-a768c664cf36 None None] MFA Rules not processed for user `fe9b99ff5b33409c9fcce8b5130497e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:22.718481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-496e66f6-1405-4c76-8fb5-a768c664cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.805909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc081a76-f1f2-4809-9d01-871b2b63cb55 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.811534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.812533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.812909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.813294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] PATH_INFO: `/v3/projects/2b80ea8a893c4f12912226372361ddce` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.814843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b80ea8a893c4f12912226372361ddce)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.817133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.845380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1129/2248] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:22.847002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e66f6-1405-4c76-8fb5-a768c664cf36 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.868229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e66f6-1405-4c76-8fb5-a768c664cf36 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:22.881931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b80ea8a893c4f12912226372361ddce', 'request_id': 'req-19a39382-feaf-4865-aa91-cf6e44f6622d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.891765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b80ea8a893c4f12912226372361ddce', 'request_id': 'req-19a39382-feaf-4865-aa91-cf6e44f6622d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.904052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b80ea8a893c4f12912226372361ddce', 'request_id': 'req-19a39382-feaf-4865-aa91-cf6e44f6622d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.917172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] The token cache is being invalidate because project 2b80ea8a893c4f12912226372361ddce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:22.917628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.918300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:22.920447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1120/2249] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:22 2022] DELETE /identity/v3/projects/2b80ea8a893c4f12912226372361ddce => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:22.922504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.924824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.935981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef9c88-90e4-46e0-b615-ba0ae7e2ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:22.936778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9c88-90e4-46e0-b615-ba0ae7e2ba4b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.937130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9c88-90e4-46e0-b615-ba0ae7e2ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.937413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9c88-90e4-46e0-b615-ba0ae7e2ba4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.938195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef9c88-90e4-46e0-b615-ba0ae7e2ba4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:22.939825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef9c88-90e4-46e0-b615-ba0ae7e2ba4b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:22.953609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1130/2250] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:22.954429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321dee-e8ad-4581-8d8f-3d0ea9219937 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:22.954785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321dee-e8ad-4581-8d8f-3d0ea9219937 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:22.955587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321dee-e8ad-4581-8d8f-3d0ea9219937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:22.974419 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-64321dee-e8ad-4581-8d8f-3d0ea9219937 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:22.976553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-64321dee-e8ad-4581-8d8f-3d0ea9219937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:22.986282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1131/2251] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:22.987167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321dee-e8ad-4581-8d8f-3d0ea9219937 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:22.991254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-64321dee-e8ad-4581-8d8f-3d0ea9219937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:23.002920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a39382-feaf-4865-aa91-cf6e44f6622d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.008268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321dee-e8ad-4581-8d8f-3d0ea9219937 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.014384 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb801d-dc5e-4606-b05f-cd769e1b3b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.015435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb801d-dc5e-4606-b05f-cd769e1b3b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.015903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb801d-dc5e-4606-b05f-cd769e1b3b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.016482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb801d-dc5e-4606-b05f-cd769e1b3b29 admin admin] PATH_INFO: `/v3/projects/9ee7b3fad718484bb8205ef3e1568186/users/01acb69bcb9f46b99ff10a0809763e18/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.018294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.018986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.019179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb801d-dc5e-4606-b05f-cd769e1b3b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee7b3fad718484bb8205ef3e1568186, user_id=01acb69bcb9f46b99ff10a0809763e18, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.019292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.019537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.022241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb801d-dc5e-4606-b05f-cd769e1b3b29 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.034502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:23.035818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1132/2252] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:22 2022] PUT /identity/v3/projects/9ee7b3fad718484bb8205ef3e1568186/users/01acb69bcb9f46b99ff10a0809763e18/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:23.037230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ee620-c263-40b1-99ac-bff418705f26 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.037659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ee620-c263-40b1-99ac-bff418705f26 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.038033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ee620-c263-40b1-99ac-bff418705f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.057883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4c7ee620-c263-40b1-99ac-bff418705f26 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:23.059068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4c7ee620-c263-40b1-99ac-bff418705f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:23.128516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.132094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.141170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1133/2253] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:23.145692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06317e-493b-4b91-96a9-263b487fbda5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.145979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06317e-493b-4b91-96a9-263b487fbda5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.146242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06317e-493b-4b91-96a9-263b487fbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.150373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1121/2254] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:23.158589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.173695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1450c-b705-487d-a11a-dff9f4034b86 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.177346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bb06317e-493b-4b91-96a9-263b487fbda5 None None] MFA Rules not processed for user `01acb69bcb9f46b99ff10a0809763e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:23.178687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bb06317e-493b-4b91-96a9-263b487fbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:23.179158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.180018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.180450 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.180871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.181757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:23.182320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.184850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.209931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1122/2255] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:23.212090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.225356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb8d4a-f0f8-4e77-9ce2-d5b8ae0404d5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.231271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195537-43c5-499b-be42-52330ed1b242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.231998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195537-43c5-499b-be42-52330ed1b242 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.232215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195537-43c5-499b-be42-52330ed1b242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.232534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195537-43c5-499b-be42-52330ed1b242 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.233226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56195537-43c5-499b-be42-52330ed1b242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.236193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56195537-43c5-499b-be42-52330ed1b242 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.269172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1123/2256] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:23 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:23.270249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195537-43c5-499b-be42-52330ed1b242 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.286301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1134/2257] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:23.287384 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06317e-493b-4b91-96a9-263b487fbda5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.298869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06317e-493b-4b91-96a9-263b487fbda5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.331771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195537-43c5-499b-be42-52330ed1b242 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.336408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.337274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.337569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.337858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.339730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:23.360415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.361449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.361609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.361851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.362598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.369670 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.399793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1135/2258] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:23 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:23.399793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.400033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:23.418383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2b89-019a-4e61-b1ed-ca897ba11beb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.420127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.423130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.425220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dce1a-3622-49c4-8048-734c32914bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.426021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dce1a-3622-49c4-8048-734c32914bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.426372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dce1a-3622-49c4-8048-734c32914bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.427322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dce1a-3622-49c4-8048-734c32914bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.436639 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1124/2259] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:23.437825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.453265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8d84c-11a1-4f38-8915-be0b5e4a003a service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.459567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0db3a8-7975-46ec-9685-f509bfa3c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.460251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db3a8-7975-46ec-9685-f509bfa3c609 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.460536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db3a8-7975-46ec-9685-f509bfa3c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.460811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db3a8-7975-46ec-9685-f509bfa3c609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.462002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0db3a8-7975-46ec-9685-f509bfa3c609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.464528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0db3a8-7975-46ec-9685-f509bfa3c609 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.483856 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1125/2260] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:23.487367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0db3a8-7975-46ec-9685-f509bfa3c609 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.504364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0db3a8-7975-46ec-9685-f509bfa3c609 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.512851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e731-f1f0-48b6-949e-59696b67b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.513931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e731-f1f0-48b6-949e-59696b67b002 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.514911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e731-f1f0-48b6-949e-59696b67b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.515687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e731-f1f0-48b6-949e-59696b67b002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.517193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e731-f1f0-48b6-949e-59696b67b002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.520047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e731-f1f0-48b6-949e-59696b67b002 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.539849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1126/2261] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:23.541214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e731-f1f0-48b6-949e-59696b67b002 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.551000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dce1a-3622-49c4-8048-734c32914bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.552643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dce1a-3622-49c4-8048-734c32914bb9 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.563449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e731-f1f0-48b6-949e-59696b67b002 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.569999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba80a90-ce97-4436-b0f6-a6418a185ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.571740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80a90-ce97-4436-b0f6-a6418a185ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.572105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80a90-ce97-4436-b0f6-a6418a185ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.572945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80a90-ce97-4436-b0f6-a6418a185ccf admin admin] PATH_INFO: `/v3/projects/953b60eea24c423d8a8ee89f3f91785f/users/65d3bf3c5a7144d18fdcf27305e84118/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.575156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1136/2262] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:23.610331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba80a90-ce97-4436-b0f6-a6418a185ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=953b60eea24c423d8a8ee89f3f91785f, user_id=65d3bf3c5a7144d18fdcf27305e84118, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.618185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba80a90-ce97-4436-b0f6-a6418a185ccf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.654114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1127/2263] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:23 2022] PUT /identity/v3/projects/953b60eea24c423d8a8ee89f3f91785f/users/65d3bf3c5a7144d18fdcf27305e84118/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:23.666809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61e36e-7e63-4208-b6d9-8d5190a230d9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.667527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61e36e-7e63-4208-b6d9-8d5190a230d9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.667918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61e36e-7e63-4208-b6d9-8d5190a230d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.704694 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1c61e36e-7e63-4208-b6d9-8d5190a230d9 None None] MFA Rules not processed for user `65d3bf3c5a7144d18fdcf27305e84118`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:23.706597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1c61e36e-7e63-4208-b6d9-8d5190a230d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:23.771300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba80a90-ce97-4436-b0f6-a6418a185ccf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:23.835178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1137/2264] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:23.867800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba80a90-ce97-4436-b0f6-a6418a185ccf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:23.876578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:23.878340 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:23.878675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:23.878972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:23.882697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:23.974509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:23.976227 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:23.998859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61e36e-7e63-4208-b6d9-8d5190a230d9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:24.013286 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1128/2265] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:41:24.013961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61e36e-7e63-4208-b6d9-8d5190a230d9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:24.020208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc51431-013f-4e8b-b962-7f359bcebf1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:24.022210 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc51431-013f-4e8b-b962-7f359bcebf1f service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:24.022564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc51431-013f-4e8b-b962-7f359bcebf1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:24.023766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc51431-013f-4e8b-b962-7f359bcebf1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:24.033159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc51431-013f-4e8b-b962-7f359bcebf1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:24.034676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc51431-013f-4e8b-b962-7f359bcebf1f service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:24.046330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1138/2266] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:41:26.387969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:26.389758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:26.466208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec2be-3e8a-4289-9ccd-47a0b482047e service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:26.471671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:26.472563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:26.472854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:26.473122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] PATH_INFO: `/v3/users/3ac29f1ebd804e75ac8dc0eac057b395` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:26.475649 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac29f1ebd804e75ac8dc0eac057b395)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:26.476334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:26.537644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac29f1ebd804e75ac8dc0eac057b395'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:26.550029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac29f1ebd804e75ac8dc0eac057b395'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:26.551035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac29f1ebd804e75ac8dc0eac057b395'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:26.551803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac29f1ebd804e75ac8dc0eac057b395'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:26.558945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac29f1ebd804e75ac8dc0eac057b395'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:26.577821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1129/2267] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:26 2022] DELETE /identity/v3/users/3ac29f1ebd804e75ac8dc0eac057b395 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:26.581907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430509-aa72-485c-9f26-1c148a863ac3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:26.582417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430509-aa72-485c-9f26-1c148a863ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:26.583010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430509-aa72-485c-9f26-1c148a863ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:26.604600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-69430509-aa72-485c-9f26-1c148a863ac3 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:26.605994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-69430509-aa72-485c-9f26-1c148a863ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:26.670288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1139/2268] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:26.682947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:26.684464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:26.751577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bddfd-4e3a-4699-963a-4dede3f2e4fa admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:26.756479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77756f-663c-4bdc-8618-758f1f4c79c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:26.757167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77756f-663c-4bdc-8618-758f1f4c79c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:26.757511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77756f-663c-4bdc-8618-758f1f4c79c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:26.757756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77756f-663c-4bdc-8618-758f1f4c79c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:26.767538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77756f-663c-4bdc-8618-758f1f4c79c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:26.769349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77756f-663c-4bdc-8618-758f1f4c79c8 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:26.779417 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1130/2269] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:26.927870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430509-aa72-485c-9f26-1c148a863ac3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:26.929791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-69430509-aa72-485c-9f26-1c148a863ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:26.950080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430509-aa72-485c-9f26-1c148a863ac3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:26.962923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:26.963836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:26.964115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:26.964382 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] PATH_INFO: `/v3/users/8d4021e1379642b284afe32bfa6e8175` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:26.965773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4021e1379642b284afe32bfa6e8175)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:26.973983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:27.066092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4021e1379642b284afe32bfa6e8175'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.083379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4021e1379642b284afe32bfa6e8175'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.084117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4021e1379642b284afe32bfa6e8175'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.093491 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4021e1379642b284afe32bfa6e8175'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.104571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4021e1379642b284afe32bfa6e8175'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.116747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1140/2270] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:26 2022] DELETE /identity/v3/users/8d4021e1379642b284afe32bfa6e8175 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:27.119043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ad1a-c38e-4dea-848a-346668b1d3cd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:27.119316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ad1a-c38e-4dea-848a-346668b1d3cd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:27.119594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ad1a-c38e-4dea-848a-346668b1d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:27.122806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:27.127175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:27.165603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a8d7ad1a-c38e-4dea-848a-346668b1d3cd None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:27.166822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a8d7ad1a-c38e-4dea-848a-346668b1d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:27.291164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242ed5-1a4c-4a97-b91c-9157c07876cc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:27.302383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1131/2271] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:27.304059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:27.306903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:27.308169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:27.308487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] PATH_INFO: `/v3/projects/2c83ceaa75814bf4ac59287f07950e53` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:27.310278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c83ceaa75814bf4ac59287f07950e53)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:27.312981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:27.324774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ad1a-c38e-4dea-848a-346668b1d3cd None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:27.326636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a8d7ad1a-c38e-4dea-848a-346668b1d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:27.390791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c83ceaa75814bf4ac59287f07950e53', 'request_id': 'req-57351650-eda1-460f-bf79-19268b14aff0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.399587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c83ceaa75814bf4ac59287f07950e53', 'request_id': 'req-57351650-eda1-460f-bf79-19268b14aff0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.413338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c83ceaa75814bf4ac59287f07950e53', 'request_id': 'req-57351650-eda1-460f-bf79-19268b14aff0'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.430256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] The token cache is being invalidate because project 2c83ceaa75814bf4ac59287f07950e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:27.432364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.433640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.440482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1141/2272] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:27 2022] DELETE /identity/v3/projects/2c83ceaa75814bf4ac59287f07950e53 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:27.455162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:27.459574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:27.471203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ad1a-c38e-4dea-848a-346668b1d3cd None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:27.576641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351650-eda1-460f-bf79-19268b14aff0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:27.583177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:27.598145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:27.598479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:27.598941 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:27.599080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:27.599399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:27.599741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:27.600565 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] PATH_INFO: `/v3/users/fe9b99ff5b33409c9fcce8b5130497e1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:27.602015 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:27.617915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9b99ff5b33409c9fcce8b5130497e1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:27.620267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:27.628092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:27.629594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:27.642283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1132/2273] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:27.710724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9b99ff5b33409c9fcce8b5130497e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.726388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9b99ff5b33409c9fcce8b5130497e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.727164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9b99ff5b33409c9fcce8b5130497e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.734128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9b99ff5b33409c9fcce8b5130497e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.745690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d7367559-2e67-4946-8268-fd99e9beab14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9b99ff5b33409c9fcce8b5130497e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:27.761652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1142/2274] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:27 2022] DELETE /identity/v3/users/fe9b99ff5b33409c9fcce8b5130497e1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:28.143538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:28.160630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0077a3-320a-427b-8910-28b3d9032130 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:28.243277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:28.244166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.244448 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.245841 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] PATH_INFO: `/v3/projects/b28be92fc54143a49c8461b8b549dd75` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.246282 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28be92fc54143a49c8461b8b549dd75)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:28.248198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:28.325714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28be92fc54143a49c8461b8b549dd75', 'request_id': 'req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.333598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28be92fc54143a49c8461b8b549dd75', 'request_id': 'req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.344734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28be92fc54143a49c8461b8b549dd75', 'request_id': 'req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.362417 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] The token cache is being invalidate because project b28be92fc54143a49c8461b8b549dd75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:28.362417 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.364378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c805a6c4-ccae-4ac2-af99-6063a9d95cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.366915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1133/2275] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:28 2022] DELETE /identity/v3/projects/b28be92fc54143a49c8461b8b549dd75 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:28.371328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2979-b81c-4e9c-b1a3-c71d6e2a0d7c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.371619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2979-b81c-4e9c-b1a3-c71d6e2a0d7c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.371896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2979-b81c-4e9c-b1a3-c71d6e2a0d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.393912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-51bc2979-b81c-4e9c-b1a3-c71d6e2a0d7c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:28.395606 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-51bc2979-b81c-4e9c-b1a3-c71d6e2a0d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:28.415908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe21691-23f4-43a3-b603-dc03ef0f7cd0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.416387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe21691-23f4-43a3-b603-dc03ef0f7cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.417094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe21691-23f4-43a3-b603-dc03ef0f7cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.448850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-afe21691-23f4-43a3-b603-dc03ef0f7cd0 None None] MFA Rules not processed for user `1ae731332a684481bef208fe5bfc4866`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:28.450082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-afe21691-23f4-43a3-b603-dc03ef0f7cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:28.478157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1143/2276] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:28.484599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2979-b81c-4e9c-b1a3-c71d6e2a0d7c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:28.486992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-51bc2979-b81c-4e9c-b1a3-c71d6e2a0d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:28.504447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2979-b81c-4e9c-b1a3-c71d6e2a0d7c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:28.509952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:28.511018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.511342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.511619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] PATH_INFO: `/v3/projects/cb991088ce1d4938a3af62c5ee21f23d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.512886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb991088ce1d4938a3af62c5ee21f23d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:28.515007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:28.548884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1134/2277] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:28.552014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c62ac-7308-4072-99f7-775a772b4bdd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.552916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c62ac-7308-4072-99f7-775a772b4bdd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.553649 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c62ac-7308-4072-99f7-775a772b4bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.575785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb991088ce1d4938a3af62c5ee21f23d', 'request_id': 'req-432e9573-d225-43ee-ab83-9032743aef7d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.582554 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d09c62ac-7308-4072-99f7-775a772b4bdd None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:28.584308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d09c62ac-7308-4072-99f7-775a772b4bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:28.585362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb991088ce1d4938a3af62c5ee21f23d', 'request_id': 'req-432e9573-d225-43ee-ab83-9032743aef7d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.595173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb991088ce1d4938a3af62c5ee21f23d', 'request_id': 'req-432e9573-d225-43ee-ab83-9032743aef7d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.609242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] The token cache is being invalidate because project cb991088ce1d4938a3af62c5ee21f23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:28.609924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.611404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.613509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1144/2278] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:28 2022] DELETE /identity/v3/projects/cb991088ce1d4938a3af62c5ee21f23d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:28.618527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:28.620025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:28.656306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1135/2279] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:28.657458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c62ac-7308-4072-99f7-775a772b4bdd None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:28.658998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d09c62ac-7308-4072-99f7-775a772b4bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:28.673124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c62ac-7308-4072-99f7-775a772b4bdd None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:28.682197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:28.683076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.683355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.683630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] PATH_INFO: `/v3/users/01acb69bcb9f46b99ff10a0809763e18` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.690268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01acb69bcb9f46b99ff10a0809763e18)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:28.692312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:28.708880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e9573-d225-43ee-ab83-9032743aef7d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:28.713934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2b32-ecf5-4301-9923-2292a387950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:28.714710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2b32-ecf5-4301-9923-2292a387950d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.714996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2b32-ecf5-4301-9923-2292a387950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.715305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2b32-ecf5-4301-9923-2292a387950d admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.716119 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2b32-ecf5-4301-9923-2292a387950d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:28.718523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2b32-ecf5-4301-9923-2292a387950d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:28.740952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01acb69bcb9f46b99ff10a0809763e18'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.748145 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1145/2280] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:28 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:28.749450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2b32-ecf5-4301-9923-2292a387950d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:28.755362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01acb69bcb9f46b99ff10a0809763e18'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.756314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01acb69bcb9f46b99ff10a0809763e18'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.757107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01acb69bcb9f46b99ff10a0809763e18'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.765092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01acb69bcb9f46b99ff10a0809763e18'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:28.783593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1136/2281] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:28 2022] DELETE /identity/v3/users/01acb69bcb9f46b99ff10a0809763e18 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:28.784593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:28.797698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:28.850560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2b32-ecf5-4301-9923-2292a387950d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:28.933293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:28.934826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.935517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.935517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.936103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:28.936407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:28.938047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:28.941742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab72c65-eca7-4117-b0c0-758770940cbc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:28.947850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5ea7f-c0c4-4ca9-8d9c-01bc154696fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:28.948449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5ea7f-c0c4-4ca9-8d9c-01bc154696fe admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:28.948736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5ea7f-c0c4-4ca9-8d9c-01bc154696fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:28.949507 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5ea7f-c0c4-4ca9-8d9c-01bc154696fe admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:28.950563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5ea7f-c0c4-4ca9-8d9c-01bc154696fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:28.953433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5ea7f-c0c4-4ca9-8d9c-01bc154696fe admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:28.961503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1146/2282] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:28.962576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:28.967199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:28.984495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1137/2283] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:28 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:28.986341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5ea7f-c0c4-4ca9-8d9c-01bc154696fe admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.002753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5ea7f-c0c4-4ca9-8d9c-01bc154696fe admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.003266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143283a2-14b8-418c-bce4-bed731e796d5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.014436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbd5dd-912f-4bfc-90f8-e07095c267f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.015235 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbd5dd-912f-4bfc-90f8-e07095c267f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.016371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbd5dd-912f-4bfc-90f8-e07095c267f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.016735 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbd5dd-912f-4bfc-90f8-e07095c267f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.018570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbd5dd-912f-4bfc-90f8-e07095c267f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.018750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395a019-155b-4cd5-a761-9e05c782b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.019512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a019-155b-4cd5-a761-9e05c782b877 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.019802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a019-155b-4cd5-a761-9e05c782b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.021132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a019-155b-4cd5-a761-9e05c782b877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.021287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbd5dd-912f-4bfc-90f8-e07095c267f3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.021932 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395a019-155b-4cd5-a761-9e05c782b877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.027173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395a019-155b-4cd5-a761-9e05c782b877 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.047788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1138/2284] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:29.052925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395a019-155b-4cd5-a761-9e05c782b877 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.066264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1147/2285] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:28 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:29.069300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbd5dd-912f-4bfc-90f8-e07095c267f3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.077571 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395a019-155b-4cd5-a761-9e05c782b877 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.247520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbd5dd-912f-4bfc-90f8-e07095c267f3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.275378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.276657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.276945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.277242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.279716 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.283671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.301532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48716b99-1820-4457-8b98-93d8a87967db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.304623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48716b99-1820-4457-8b98-93d8a87967db admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.304873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48716b99-1820-4457-8b98-93d8a87967db admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.305154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48716b99-1820-4457-8b98-93d8a87967db admin admin] PATH_INFO: `/v3/projects/9b9982dbfd59465783f2847fbcb8d441/users/a2030802aa894e66a31a7731b265f22a/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.360159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1148/2286] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:29 2022] POST /identity/v3/users => generated 297 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:29.360159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.362807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:29.364198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48716b99-1820-4457-8b98-93d8a87967db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9982dbfd59465783f2847fbcb8d441, user_id=a2030802aa894e66a31a7731b265f22a, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.367733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48716b99-1820-4457-8b98-93d8a87967db admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.380104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b45ae-714a-4ee8-95a6-07c76afdb061 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.386844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.387809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.388199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.388520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] PATH_INFO: `/v3/projects/9ee7b3fad718484bb8205ef3e1568186` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.389938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee7b3fad718484bb8205ef3e1568186)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.392248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.404915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1139/2287] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:29 2022] PUT /identity/v3/projects/9b9982dbfd59465783f2847fbcb8d441/users/a2030802aa894e66a31a7731b265f22a/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:29.406453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48716b99-1820-4457-8b98-93d8a87967db admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.476484 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee7b3fad718484bb8205ef3e1568186', 'request_id': 'req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:29.488157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee7b3fad718484bb8205ef3e1568186', 'request_id': 'req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:29.498437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee7b3fad718484bb8205ef3e1568186', 'request_id': 'req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:29.516904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] The token cache is being invalidate because project 9ee7b3fad718484bb8205ef3e1568186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:29.517522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:29.518933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:29.521007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1149/2288] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:29 2022] DELETE /identity/v3/projects/9ee7b3fad718484bb8205ef3e1568186 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:29.522050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.523688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:29.526618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48716b99-1820-4457-8b98-93d8a87967db admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.622486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dcf2b-876e-4d91-98c9-ae191fbd8064 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.626226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7973b0-3fc7-4a70-bc75-5c91a7eb0510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.626923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7973b0-3fc7-4a70-bc75-5c91a7eb0510 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.627243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7973b0-3fc7-4a70-bc75-5c91a7eb0510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.627526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7973b0-3fc7-4a70-bc75-5c91a7eb0510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.628265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.629197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7973b0-3fc7-4a70-bc75-5c91a7eb0510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.630390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.630764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.631202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.632037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.633946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.634579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7973b0-3fc7-4a70-bc75-5c91a7eb0510 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.647158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1140/2289] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:29.649016 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00169c8-bebe-447b-9196-317648309c57 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.649452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00169c8-bebe-447b-9196-317648309c57 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.650665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00169c8-bebe-447b-9196-317648309c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.654833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1150/2290] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:29.655614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.659870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:29.672613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4777499-aff1-4229-8cc7-f1723aa0dfa3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.675931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a00169c8-bebe-447b-9196-317648309c57 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:29.677648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a00169c8-bebe-447b-9196-317648309c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:29.679997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1786-6421-44b7-8589-404ba6b89ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.680662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1786-6421-44b7-8589-404ba6b89ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.681113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1786-6421-44b7-8589-404ba6b89ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.681361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1786-6421-44b7-8589-404ba6b89ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.682121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1786-6421-44b7-8589-404ba6b89ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.685701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1786-6421-44b7-8589-404ba6b89ff6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.691831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1141/2291] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:29.693179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00169c8-bebe-447b-9196-317648309c57 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.696325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1151/2292] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:29.702275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d35c-6b0c-4f49-abae-37bb5beb5902 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.702701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d35c-6b0c-4f49-abae-37bb5beb5902 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.703110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d35c-6b0c-4f49-abae-37bb5beb5902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.709878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00169c8-bebe-447b-9196-317648309c57 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.718672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ab327-5ecd-4d7f-bb61-0b68d06e2804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.719607 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ab327-5ecd-4d7f-bb61-0b68d06e2804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.719886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ab327-5ecd-4d7f-bb61-0b68d06e2804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.720152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ab327-5ecd-4d7f-bb61-0b68d06e2804 admin admin] PATH_INFO: `/v3/projects/9b9982dbfd59465783f2847fbcb8d441/users/a2030802aa894e66a31a7731b265f22a/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.722248 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ab327-5ecd-4d7f-bb61-0b68d06e2804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9982dbfd59465783f2847fbcb8d441, user_id=a2030802aa894e66a31a7731b265f22a, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.725725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ab327-5ecd-4d7f-bb61-0b68d06e2804 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.730067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8a84d35c-6b0c-4f49-abae-37bb5beb5902 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:29.731255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8a84d35c-6b0c-4f49-abae-37bb5beb5902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:29.741570 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1142/2293] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:29 2022] PUT /identity/v3/projects/9b9982dbfd59465783f2847fbcb8d441/users/a2030802aa894e66a31a7731b265f22a/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:29.742647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ab327-5ecd-4d7f-bb61-0b68d06e2804 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.812498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1152/2294] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:29.817723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d35c-6b0c-4f49-abae-37bb5beb5902 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.831497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d35c-6b0c-4f49-abae-37bb5beb5902 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.846563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.847467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.848845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.849185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.851463 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:29.851959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.855944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.868714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ab327-5ecd-4d7f-bb61-0b68d06e2804 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.873921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d671d7c-39e3-4f97-aff0-4a901a3e5c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.874873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671d7c-39e3-4f97-aff0-4a901a3e5c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.875154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671d7c-39e3-4f97-aff0-4a901a3e5c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.875427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d671d7c-39e3-4f97-aff0-4a901a3e5c2c admin admin] PATH_INFO: `/v3/projects/26d20e63f6bf41a29a27b938907f8c5a/users/b0c7e31f0afb4492853ee84164a3e1d6/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.880399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1153/2295] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:29.881760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:29.892151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d671d7c-39e3-4f97-aff0-4a901a3e5c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d20e63f6bf41a29a27b938907f8c5a, user_id=b0c7e31f0afb4492853ee84164a3e1d6, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.895411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d671d7c-39e3-4f97-aff0-4a901a3e5c2c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.898350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10681d-195f-4e64-9597-858270178db3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:29.914020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce118-b229-48ad-bc74-0ef0781307c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:29.914341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1143/2296] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:29 2022] PUT /identity/v3/projects/26d20e63f6bf41a29a27b938907f8c5a/users/b0c7e31f0afb4492853ee84164a3e1d6/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:29.915136 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce118-b229-48ad-bc74-0ef0781307c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.915483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce118-b229-48ad-bc74-0ef0781307c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.915765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce118-b229-48ad-bc74-0ef0781307c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.916485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ce118-b229-48ad-bc74-0ef0781307c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:29.918551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ce118-b229-48ad-bc74-0ef0781307c9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:29.926313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f63ab-b512-44b6-b702-7eb595a88916 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:29.926666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f63ab-b512-44b6-b702-7eb595a88916 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:29.927031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f63ab-b512-44b6-b702-7eb595a88916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:29.956657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-938f63ab-b512-44b6-b702-7eb595a88916 None None] MFA Rules not processed for user `b0c7e31f0afb4492853ee84164a3e1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:29.958211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-938f63ab-b512-44b6-b702-7eb595a88916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:29.981425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1154/2297] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:29 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:29.982536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce118-b229-48ad-bc74-0ef0781307c9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.054007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1144/2298] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:30.059110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f63ab-b512-44b6-b702-7eb595a88916 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.074063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce118-b229-48ad-bc74-0ef0781307c9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.080513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3425a6-d678-49b8-8916-7ac8e51b9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.081841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3425a6-d678-49b8-8916-7ac8e51b9fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.082263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3425a6-d678-49b8-8916-7ac8e51b9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.082678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3425a6-d678-49b8-8916-7ac8e51b9fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.083540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3425a6-d678-49b8-8916-7ac8e51b9fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.085866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3425a6-d678-49b8-8916-7ac8e51b9fb9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.117046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1155/2299] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:29 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:30.121390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3425a6-d678-49b8-8916-7ac8e51b9fb9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.134468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3425a6-d678-49b8-8916-7ac8e51b9fb9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.135650 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f63ab-b512-44b6-b702-7eb595a88916 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.140367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a592-f40d-4768-a344-60cb50804b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.140781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ecee7-872f-46ba-8028-14ff0d14a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.141814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ecee7-872f-46ba-8028-14ff0d14a3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.142338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a592-f40d-4768-a344-60cb50804b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.143040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a592-f40d-4768-a344-60cb50804b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.143325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ecee7-872f-46ba-8028-14ff0d14a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.143625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a592-f40d-4768-a344-60cb50804b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.143921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ecee7-872f-46ba-8028-14ff0d14a3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.144667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a592-f40d-4768-a344-60cb50804b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.144835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ecee7-872f-46ba-8028-14ff0d14a3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.146771 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a592-f40d-4768-a344-60cb50804b08 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.147187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ecee7-872f-46ba-8028-14ff0d14a3b7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.162504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1156/2300] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:30.168831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a592-f40d-4768-a344-60cb50804b08 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.181617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a592-f40d-4768-a344-60cb50804b08 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.185939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1145/2301] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:30 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:30.186830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8784ab3-a7fa-4f45-a5a7-6ac560573aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.187530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8784ab3-a7fa-4f45-a5a7-6ac560573aff admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.187811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8784ab3-a7fa-4f45-a5a7-6ac560573aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.188085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8784ab3-a7fa-4f45-a5a7-6ac560573aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.188995 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8784ab3-a7fa-4f45-a5a7-6ac560573aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.189505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ecee7-872f-46ba-8028-14ff0d14a3b7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.190734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8784ab3-a7fa-4f45-a5a7-6ac560573aff admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.211569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1157/2302] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:30.216686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8784ab3-a7fa-4f45-a5a7-6ac560573aff admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.235603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8784ab3-a7fa-4f45-a5a7-6ac560573aff admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.266069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ecee7-872f-46ba-8028-14ff0d14a3b7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.271546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3486-f33c-4dba-81d6-1549b6037387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.272602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3486-f33c-4dba-81d6-1549b6037387 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.273074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3486-f33c-4dba-81d6-1549b6037387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.273456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3486-f33c-4dba-81d6-1549b6037387 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.274278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c3486-f33c-4dba-81d6-1549b6037387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.276300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c3486-f33c-4dba-81d6-1549b6037387 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.313596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e8e23-a601-45b1-947f-c6b4078f04c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.314671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e8e23-a601-45b1-947f-c6b4078f04c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.315124 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e8e23-a601-45b1-947f-c6b4078f04c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.316149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e8e23-a601-45b1-947f-c6b4078f04c4 admin admin] PATH_INFO: `/v3/projects/11978a2a4a7b4141bfde1d2a91e8cb13/users/f8619ea348dc4895b88749122230ad56/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.322920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1146/2303] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:30 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:30.329867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3486-f33c-4dba-81d6-1549b6037387 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.335797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e8e23-a601-45b1-947f-c6b4078f04c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11978a2a4a7b4141bfde1d2a91e8cb13, user_id=f8619ea348dc4895b88749122230ad56, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.338945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e8e23-a601-45b1-947f-c6b4078f04c4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.344827 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3486-f33c-4dba-81d6-1549b6037387 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.350303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441fa8f-83f9-425b-87b7-c8c2d9aba777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.351123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fa8f-83f9-425b-87b7-c8c2d9aba777 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.351413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fa8f-83f9-425b-87b7-c8c2d9aba777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.351773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fa8f-83f9-425b-87b7-c8c2d9aba777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.352563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441fa8f-83f9-425b-87b7-c8c2d9aba777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.354191 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441fa8f-83f9-425b-87b7-c8c2d9aba777 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.359225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1158/2304] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:30 2022] PUT /identity/v3/projects/11978a2a4a7b4141bfde1d2a91e8cb13/users/f8619ea348dc4895b88749122230ad56/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:30.367216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1147/2305] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:30.371260 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93184-8fcc-42a5-bf2e-467fb14679c6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.371745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93184-8fcc-42a5-bf2e-467fb14679c6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.371947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441fa8f-83f9-425b-87b7-c8c2d9aba777 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.372103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93184-8fcc-42a5-bf2e-467fb14679c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.392104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441fa8f-83f9-425b-87b7-c8c2d9aba777 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.406663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9ec93184-8fcc-42a5-bf2e-467fb14679c6 None None] MFA Rules not processed for user `f8619ea348dc4895b88749122230ad56`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:30.408091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ec93184-8fcc-42a5-bf2e-467fb14679c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:30.489043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f291-a3f7-4cab-a9ce-54169617ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.490273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f291-a3f7-4cab-a9ce-54169617ccb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.490957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f291-a3f7-4cab-a9ce-54169617ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.491307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f291-a3f7-4cab-a9ce-54169617ccb3 admin admin] PATH_INFO: `/v3/projects/ec3646dfdb2f4491b99e4373442ff882/users/1cdc1f5851864a6f8e206a6275903007/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.510870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98f291-a3f7-4cab-a9ce-54169617ccb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3646dfdb2f4491b99e4373442ff882, user_id=1cdc1f5851864a6f8e206a6275903007, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.511992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1159/2306] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:30.514320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec93184-8fcc-42a5-bf2e-467fb14679c6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.515003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98f291-a3f7-4cab-a9ce-54169617ccb3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.516613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ec93184-8fcc-42a5-bf2e-467fb14679c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:30.541606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1148/2307] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:30 2022] PUT /identity/v3/projects/ec3646dfdb2f4491b99e4373442ff882/users/1cdc1f5851864a6f8e206a6275903007/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:30.543039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f291-a3f7-4cab-a9ce-54169617ccb3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.605959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec93184-8fcc-42a5-bf2e-467fb14679c6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.621977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f291-a3f7-4cab-a9ce-54169617ccb3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.630038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e399859-69c4-4a31-9bee-e05c65088da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.630839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e399859-69c4-4a31-9bee-e05c65088da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.631050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e399859-69c4-4a31-9bee-e05c65088da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.631329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e399859-69c4-4a31-9bee-e05c65088da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.632232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e399859-69c4-4a31-9bee-e05c65088da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.634104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e399859-69c4-4a31-9bee-e05c65088da8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.649390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1149/2308] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:30.653489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e399859-69c4-4a31-9bee-e05c65088da8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.675491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e399859-69c4-4a31-9bee-e05c65088da8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:30.680896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.682351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.682786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.683246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.683564 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4db0c5-3a84-4257-bee5-6ff3d1d65306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:30.685045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db0c5-3a84-4257-bee5-6ff3d1d65306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.685331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db0c5-3a84-4257-bee5-6ff3d1d65306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.685989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db0c5-3a84-4257-bee5-6ff3d1d65306 admin admin] PATH_INFO: `/v3/projects/ec3646dfdb2f4491b99e4373442ff882/users/1cdc1f5851864a6f8e206a6275903007/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.689203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4db0c5-3a84-4257-bee5-6ff3d1d65306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3646dfdb2f4491b99e4373442ff882, user_id=1cdc1f5851864a6f8e206a6275903007, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.693165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4db0c5-3a84-4257-bee5-6ff3d1d65306 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.706774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1150/2309] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:30 2022] PUT /identity/v3/projects/ec3646dfdb2f4491b99e4373442ff882/users/1cdc1f5851864a6f8e206a6275903007/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:30.718580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63435b3-f5a0-4dcd-81fe-8e2b1ab2daed None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:30.718879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63435b3-f5a0-4dcd-81fe-8e2b1ab2daed None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:30.720752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63435b3-f5a0-4dcd-81fe-8e2b1ab2daed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:30.764907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b63435b3-f5a0-4dcd-81fe-8e2b1ab2daed None None] MFA Rules not processed for user `1cdc1f5851864a6f8e206a6275903007`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:30.766514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b63435b3-f5a0-4dcd-81fe-8e2b1ab2daed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:30.779287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:30.780755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:30.805983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1160/2310] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:30.916474 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1151/2311] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:30.928560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:30.930102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:30.949391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4906c-3713-448a-81ba-8265af81aec1 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:31.072108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef916b04-a76f-415f-83e8-51cc009574ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:31.072858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef916b04-a76f-415f-83e8-51cc009574ae service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:31.073227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef916b04-a76f-415f-83e8-51cc009574ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:31.073530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef916b04-a76f-415f-83e8-51cc009574ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:31.085760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef916b04-a76f-415f-83e8-51cc009574ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:31.087800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef916b04-a76f-415f-83e8-51cc009574ae service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:31.099734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1161/2312] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:31.163542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63435b3-f5a0-4dcd-81fe-8e2b1ab2daed None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:31.176904 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63435b3-f5a0-4dcd-81fe-8e2b1ab2daed None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:31.195487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:31.196320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:31.196598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:31.196877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:31.397092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:31.399103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:31.413352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1152/2313] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:36.162204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bfc34-ff37-459f-b0d8-962f77aa42c3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:36.162752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bfc34-ff37-459f-b0d8-962f77aa42c3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:36.162752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bfc34-ff37-459f-b0d8-962f77aa42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:36.193116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bf7bfc34-ff37-459f-b0d8-962f77aa42c3 None None] MFA Rules not processed for user `a2030802aa894e66a31a7731b265f22a`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:36.194686 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bf7bfc34-ff37-459f-b0d8-962f77aa42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:36.265395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1162/2314] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:36.278868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:36.280526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:36.367577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a720b-572a-4d72-9859-1deb9c77b42d service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:36.373305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6057b-f3e6-4f63-94b0-13251d6b0588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:36.373994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6057b-f3e6-4f63-94b0-13251d6b0588 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:36.374276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6057b-f3e6-4f63-94b0-13251d6b0588 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:36.374695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6057b-f3e6-4f63-94b0-13251d6b0588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:36.376687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4ad6057b-f3e6-4f63-94b0-13251d6b0588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:36.432513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6057b-f3e6-4f63-94b0-13251d6b0588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:36.434145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6057b-f3e6-4f63-94b0-13251d6b0588 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:36.444219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1153/2315] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:37.616006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b443-805e-4146-b360-b18f38bdd439 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:37.616476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b443-805e-4146-b360-b18f38bdd439 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:37.616683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b443-805e-4146-b360-b18f38bdd439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:37.635283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f319b443-805e-4146-b360-b18f38bdd439 None None] MFA Rules not processed for user `1ae731332a684481bef208fe5bfc4866`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:37.636740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f319b443-805e-4146-b360-b18f38bdd439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:37.644224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1163/2316] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:41.314889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2116c-8e86-4f91-8f9f-5adf5a879e8a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:41.315432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2116c-8e86-4f91-8f9f-5adf5a879e8a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:41.315576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2116c-8e86-4f91-8f9f-5adf5a879e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:41.338501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a9f2116c-8e86-4f91-8f9f-5adf5a879e8a None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:41.345667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a9f2116c-8e86-4f91-8f9f-5adf5a879e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:41.413903 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1154/2317] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:41:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:41.470039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319b443-805e-4146-b360-b18f38bdd439 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:41.472135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f319b443-805e-4146-b360-b18f38bdd439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:41.556059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319b443-805e-4146-b360-b18f38bdd439 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:41.563665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631df6c-c969-4b38-a37e-7179db991fed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:41.564569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631df6c-c969-4b38-a37e-7179db991fed service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:41.564935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631df6c-c969-4b38-a37e-7179db991fed service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:41.565343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631df6c-c969-4b38-a37e-7179db991fed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:41.577167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631df6c-c969-4b38-a37e-7179db991fed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:41.578939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631df6c-c969-4b38-a37e-7179db991fed service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:41.590759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1164/2318] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:41:41.881726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2116c-8e86-4f91-8f9f-5adf5a879e8a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:41.952098 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2116c-8e86-4f91-8f9f-5adf5a879e8a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:41.957583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:41.958473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:41.958710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:41.959010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] PATH_INFO: `/v3/users/b0c7e31f0afb4492853ee84164a3e1d6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:41.960303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c7e31f0afb4492853ee84164a3e1d6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:41.962361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:42.019272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c7e31f0afb4492853ee84164a3e1d6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.036913 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c7e31f0afb4492853ee84164a3e1d6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.037798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c7e31f0afb4492853ee84164a3e1d6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.038671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c7e31f0afb4492853ee84164a3e1d6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.046721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c7e31f0afb4492853ee84164a3e1d6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.061947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1155/2319] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:41 2022] DELETE /identity/v3/users/b0c7e31f0afb4492853ee84164a3e1d6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:42.067434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343224-d36a-46c7-9f57-51c85c4cb95f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:42.067970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343224-d36a-46c7-9f57-51c85c4cb95f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:42.068363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343224-d36a-46c7-9f57-51c85c4cb95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:42.087818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cc343224-d36a-46c7-9f57-51c85c4cb95f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:42.089025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cc343224-d36a-46c7-9f57-51c85c4cb95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:42.173838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1165/2320] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:42.184651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:42.186406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:42.198044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc343224-d36a-46c7-9f57-51c85c4cb95f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:42.199583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cc343224-d36a-46c7-9f57-51c85c4cb95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:42.215402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc343224-d36a-46c7-9f57-51c85c4cb95f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:42.221390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:42.222510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:42.222951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:42.223547 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] PATH_INFO: `/v3/users/f8619ea348dc4895b88749122230ad56` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:42.224756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8619ea348dc4895b88749122230ad56)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:42.226708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:42.268068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ac937-d93f-41f7-b317-56885a6a7850 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:42.272513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d118837-c592-4bfa-8ceb-115943ce08a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:42.273066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d118837-c592-4bfa-8ceb-115943ce08a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:42.273452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d118837-c592-4bfa-8ceb-115943ce08a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:42.273676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d118837-c592-4bfa-8ceb-115943ce08a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:42.284279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8619ea348dc4895b88749122230ad56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.285458 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d118837-c592-4bfa-8ceb-115943ce08a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:42.286999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d118837-c592-4bfa-8ceb-115943ce08a4 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:42.300901 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1156/2321] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:42.304877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8619ea348dc4895b88749122230ad56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.305668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8619ea348dc4895b88749122230ad56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.313474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8619ea348dc4895b88749122230ad56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.323208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8619ea348dc4895b88749122230ad56'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.330266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1166/2322] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:42 2022] DELETE /identity/v3/users/f8619ea348dc4895b88749122230ad56 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:42.335252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4f17-45dd-4151-9757-800761b3e28b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:42.335801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4f17-45dd-4151-9757-800761b3e28b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:42.335801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4f17-45dd-4151-9757-800761b3e28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:42.370531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-503a4f17-45dd-4151-9757-800761b3e28b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:42.376758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-503a4f17-45dd-4151-9757-800761b3e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:42.493673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1157/2323] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:42.504689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:42.506151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:42.587661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5678d-b356-477d-a11f-a79c54b58300 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:42.592406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8c02-d8f4-4b1c-9cdb-6ca86d770cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:42.593312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8c02-d8f4-4b1c-9cdb-6ca86d770cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:42.593781 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8c02-d8f4-4b1c-9cdb-6ca86d770cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:42.594218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8c02-d8f4-4b1c-9cdb-6ca86d770cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:42.605949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a8c02-d8f4-4b1c-9cdb-6ca86d770cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:42.608365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a8c02-d8f4-4b1c-9cdb-6ca86d770cc3 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:42.622861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1167/2324] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:42.720819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a4f17-45dd-4151-9757-800761b3e28b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:42.722578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-503a4f17-45dd-4151-9757-800761b3e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:42.741671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a4f17-45dd-4151-9757-800761b3e28b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:42.761603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:42.762929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:42.763511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:42.763992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] PATH_INFO: `/v3/projects/26d20e63f6bf41a29a27b938907f8c5a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:42.765530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d20e63f6bf41a29a27b938907f8c5a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:42.768513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:42.867958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d20e63f6bf41a29a27b938907f8c5a', 'request_id': 'req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.882392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d20e63f6bf41a29a27b938907f8c5a', 'request_id': 'req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.896668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d20e63f6bf41a29a27b938907f8c5a', 'request_id': 'req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.917692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] The token cache is being invalidate because project 26d20e63f6bf41a29a27b938907f8c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:42.917692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.919078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:42.922891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1158/2325] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:42 2022] DELETE /identity/v3/projects/26d20e63f6bf41a29a27b938907f8c5a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:42.928614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8c02-d8f4-4b1c-9cdb-6ca86d770cc3 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:42.940539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8c02-d8f4-4b1c-9cdb-6ca86d770cc3 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:43.022236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:43.023421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.024860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.025728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] PATH_INFO: `/v3/users/1cdc1f5851864a6f8e206a6275903007` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.029672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdc1f5851864a6f8e206a6275903007)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:43.032304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:43.122342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdc1f5851864a6f8e206a6275903007'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.158456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdc1f5851864a6f8e206a6275903007'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.159199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdc1f5851864a6f8e206a6275903007'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.171156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdc1f5851864a6f8e206a6275903007'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.172155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:43.173620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:43.224411 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c8d14e3f-9ece-45bd-8d11-cd1548b17230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdc1f5851864a6f8e206a6275903007'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.240178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3c1f8-ab8d-44f3-9e02-56d5c8a724ad admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:43.245519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1168/2326] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:42 2022] DELETE /identity/v3/users/1cdc1f5851864a6f8e206a6275903007 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:43.249874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:43.250943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.251407 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.251952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] PATH_INFO: `/v3/projects/11978a2a4a7b4141bfde1d2a91e8cb13` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.253448 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=11978a2a4a7b4141bfde1d2a91e8cb13)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:43.255708 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:43.327159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11978a2a4a7b4141bfde1d2a91e8cb13', 'request_id': 'req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.341395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11978a2a4a7b4141bfde1d2a91e8cb13', 'request_id': 'req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.362695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11978a2a4a7b4141bfde1d2a91e8cb13', 'request_id': 'req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.383402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] The token cache is being invalidate because project 11978a2a4a7b4141bfde1d2a91e8cb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:43.383906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.384986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5807ce1b-e8b6-4816-99eb-1b315d7d6cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.395052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1159/2327] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:43 2022] DELETE /identity/v3/projects/11978a2a4a7b4141bfde1d2a91e8cb13 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:43.400538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c46c-bf49-4e96-9e70-349579230e32 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.400906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c46c-bf49-4e96-9e70-349579230e32 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.401391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c46c-bf49-4e96-9e70-349579230e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.421334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7160c46c-bf49-4e96-9e70-349579230e32 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:43.422967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7160c46c-bf49-4e96-9e70-349579230e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:43.573163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1169/2328] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:43.582688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760be2-e22c-4cb6-ae77-2e08d103bbea None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.582977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760be2-e22c-4cb6-ae77-2e08d103bbea None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.583254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760be2-e22c-4cb6-ae77-2e08d103bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.637050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c46c-bf49-4e96-9e70-349579230e32 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:43.638676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7160c46c-bf49-4e96-9e70-349579230e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:43.641478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d0760be2-e22c-4cb6-ae77-2e08d103bbea None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:43.644371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d0760be2-e22c-4cb6-ae77-2e08d103bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:43.664808 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1160/2329] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:43.666681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0760be2-e22c-4cb6-ae77-2e08d103bbea None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:43.672149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c46c-bf49-4e96-9e70-349579230e32 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:43.687402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0760be2-e22c-4cb6-ae77-2e08d103bbea None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:43.695662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:43.697111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.697577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.698213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.700041 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:43.700900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:43.703749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:43.723110 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:43.724813 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.726395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.726895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] PATH_INFO: `/v3/projects/ec3646dfdb2f4491b99e4373442ff882` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.728318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1161/2330] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:43.728728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3646dfdb2f4491b99e4373442ff882)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:43.730339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:43.731156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:43.746725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616b9e3-2968-4d73-8a78-dec1620838b4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:43.755652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddd966-5438-4ccd-90e6-f481058d1db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:43.757001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd966-5438-4ccd-90e6-f481058d1db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.757850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd966-5438-4ccd-90e6-f481058d1db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.758323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddd966-5438-4ccd-90e6-f481058d1db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.759666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddd966-5438-4ccd-90e6-f481058d1db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:43.762085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddd966-5438-4ccd-90e6-f481058d1db3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:43.803412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1162/2331] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:43 2022] POST /identity/v3/projects => generated 361 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:43.809195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddd966-5438-4ccd-90e6-f481058d1db3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:43.811109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3646dfdb2f4491b99e4373442ff882', 'request_id': 'req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.819413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3646dfdb2f4491b99e4373442ff882', 'request_id': 'req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.829584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3646dfdb2f4491b99e4373442ff882', 'request_id': 'req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.845823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] The token cache is being invalidate because project ec3646dfdb2f4491b99e4373442ff882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:43.846211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.847006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e1c37fa-db34-4b08-a510-b0764a3ab6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:43.848876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1170/2332] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:43 2022] DELETE /identity/v3/projects/ec3646dfdb2f4491b99e4373442ff882 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:43.854710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52933bd-7728-493d-ae3c-b147929b4021 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.855002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52933bd-7728-493d-ae3c-b147929b4021 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.857922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52933bd-7728-493d-ae3c-b147929b4021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.880922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a52933bd-7728-493d-ae3c-b147929b4021 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:43.882203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a52933bd-7728-493d-ae3c-b147929b4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:43.898832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddd966-5438-4ccd-90e6-f481058d1db3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:43.911183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:43.912796 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.913324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.914140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:43.915770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:43.918262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:43.956588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1163/2333] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:43 2022] POST /identity/v3/users => generated 281 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:43.957543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:43.959680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:43.982707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb3fb5-1cb7-4722-9674-01ed46fccfee admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:43.991404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1171/2334] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:43.994146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d877a-e6db-47d9-9179-d96e0bdcdbe2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:43.994321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d877a-e6db-47d9-9179-d96e0bdcdbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:43.994656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d877a-e6db-47d9-9179-d96e0bdcdbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.000400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f5c0-fe98-4d9d-8667-b1e60a995455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.001337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f5c0-fe98-4d9d-8667-b1e60a995455 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.001566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f5c0-fe98-4d9d-8667-b1e60a995455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.002070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f5c0-fe98-4d9d-8667-b1e60a995455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.002978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f5c0-fe98-4d9d-8667-b1e60a995455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.004837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f5c0-fe98-4d9d-8667-b1e60a995455 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.015633 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-214d877a-e6db-47d9-9179-d96e0bdcdbe2 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:44.020024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1164/2335] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:44.020231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-214d877a-e6db-47d9-9179-d96e0bdcdbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:44.030601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1172/2336] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:44.030774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f5c0-fe98-4d9d-8667-b1e60a995455 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.031322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d877a-e6db-47d9-9179-d96e0bdcdbe2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.041075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f5c0-fe98-4d9d-8667-b1e60a995455 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.041627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d877a-e6db-47d9-9179-d96e0bdcdbe2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.046416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24514701-53e0-4db4-a343-b287609a9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.047117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24514701-53e0-4db4-a343-b287609a9197 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.047398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24514701-53e0-4db4-a343-b287609a9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.047618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24514701-53e0-4db4-a343-b287609a9197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.048090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.048346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24514701-53e0-4db4-a343-b287609a9197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.049168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.049774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.050072 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24514701-53e0-4db4-a343-b287609a9197 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.050280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.052091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:44.052656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.055230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.066415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1165/2337] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:44.068292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1173/2338] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:44.073041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.073219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24514701-53e0-4db4-a343-b287609a9197 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.086664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550575-a9de-4523-ab9a-b3ffba26dc6c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.093538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24514701-53e0-4db4-a343-b287609a9197 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.109299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18518881-108e-4373-9905-8f50987c8f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.110284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84839ff1-232f-4083-a9cf-b0047717b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.110439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518881-108e-4373-9905-8f50987c8f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.110631 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518881-108e-4373-9905-8f50987c8f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.111138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518881-108e-4373-9905-8f50987c8f57 admin admin] PATH_INFO: `/v3/projects/0128f84887ba4534877574d6e65af28a/users/c7780dbb97d54432971f70f0268dd8cc/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.111727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839ff1-232f-4083-a9cf-b0047717b595 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.112176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839ff1-232f-4083-a9cf-b0047717b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.113784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839ff1-232f-4083-a9cf-b0047717b595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.114760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84839ff1-232f-4083-a9cf-b0047717b595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.119708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84839ff1-232f-4083-a9cf-b0047717b595 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.136145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18518881-108e-4373-9905-8f50987c8f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0128f84887ba4534877574d6e65af28a, user_id=c7780dbb97d54432971f70f0268dd8cc, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.139461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18518881-108e-4373-9905-8f50987c8f57 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.163829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1166/2339] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:44 2022] PUT /identity/v3/projects/0128f84887ba4534877574d6e65af28a/users/c7780dbb97d54432971f70f0268dd8cc/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:44.184346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e50a-5c1c-4428-96c9-598c61f3f18c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.184754 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e50a-5c1c-4428-96c9-598c61f3f18c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.185006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e50a-5c1c-4428-96c9-598c61f3f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.199311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1174/2340] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:44 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:44.205584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84839ff1-232f-4083-a9cf-b0047717b595 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.226204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-99b1e50a-5c1c-4428-96c9-598c61f3f18c None None] MFA Rules not processed for user `c7780dbb97d54432971f70f0268dd8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:44.227709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-99b1e50a-5c1c-4428-96c9-598c61f3f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:44.368052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84839ff1-232f-4083-a9cf-b0047717b595 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.375349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1167/2341] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:44.392075 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af899115-f350-4cb9-8b98-050d926f0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.393800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af899115-f350-4cb9-8b98-050d926f0917 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.394275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af899115-f350-4cb9-8b98-050d926f0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.395196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af899115-f350-4cb9-8b98-050d926f0917 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.396295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af899115-f350-4cb9-8b98-050d926f0917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.398836 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af899115-f350-4cb9-8b98-050d926f0917 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.415922 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1e50a-5c1c-4428-96c9-598c61f3f18c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.418192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-99b1e50a-5c1c-4428-96c9-598c61f3f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:44.448208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1175/2342] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:44 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:44.449431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af899115-f350-4cb9-8b98-050d926f0917 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.463497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af899115-f350-4cb9-8b98-050d926f0917 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.469490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeb6f6-bc23-4014-bdee-d1b88a28f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.470571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeb6f6-bc23-4014-bdee-d1b88a28f109 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.470854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeb6f6-bc23-4014-bdee-d1b88a28f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.471132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeb6f6-bc23-4014-bdee-d1b88a28f109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.471871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeb6f6-bc23-4014-bdee-d1b88a28f109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.474126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeb6f6-bc23-4014-bdee-d1b88a28f109 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.490076 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1176/2343] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:44.490817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1e50a-5c1c-4428-96c9-598c61f3f18c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.500937 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27975411-cc9f-472c-985f-3655d5351419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.502008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975411-cc9f-472c-985f-3655d5351419 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.502801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975411-cc9f-472c-985f-3655d5351419 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.502801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975411-cc9f-472c-985f-3655d5351419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.503691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeb6f6-bc23-4014-bdee-d1b88a28f109 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.518185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27975411-cc9f-472c-985f-3655d5351419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.519088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeb6f6-bc23-4014-bdee-d1b88a28f109 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.520408 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27975411-cc9f-472c-985f-3655d5351419 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.524679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed7562-30fe-4102-ba68-199a9312da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.525729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed7562-30fe-4102-ba68-199a9312da7d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.526183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed7562-30fe-4102-ba68-199a9312da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.526459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed7562-30fe-4102-ba68-199a9312da7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.527238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed7562-30fe-4102-ba68-199a9312da7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.528848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed7562-30fe-4102-ba68-199a9312da7d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.535181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1168/2344] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:44.550103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1177/2345] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:44.550205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27975411-cc9f-472c-985f-3655d5351419 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.550994 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed7562-30fe-4102-ba68-199a9312da7d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.559798 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27975411-cc9f-472c-985f-3655d5351419 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.562566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed7562-30fe-4102-ba68-199a9312da7d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.565164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7c6ca-bb08-4b83-84c7-73424bb64bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.566216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7c6ca-bb08-4b83-84c7-73424bb64bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.566632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7c6ca-bb08-4b83-84c7-73424bb64bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.567003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7c6ca-bb08-4b83-84c7-73424bb64bc1 admin admin] PATH_INFO: `/v3/projects/ef6307fc70144bb5ab16b147869370ba/users/76ac29b70a38469e9aa851863ffe172e/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.567688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.568839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.569119 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.569396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] PATH_INFO: `/v3/users/c7780dbb97d54432971f70f0268dd8cc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.570613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7780dbb97d54432971f70f0268dd8cc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.572786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.607127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7c6ca-bb08-4b83-84c7-73424bb64bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6307fc70144bb5ab16b147869370ba, user_id=76ac29b70a38469e9aa851863ffe172e, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.610202 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7c6ca-bb08-4b83-84c7-73424bb64bc1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.638603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1169/2346] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:44 2022] PUT /identity/v3/projects/ef6307fc70144bb5ab16b147869370ba/users/76ac29b70a38469e9aa851863ffe172e/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:44.656153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13c7c-c68e-4bad-b94d-db5d2a151ccd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.656527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13c7c-c68e-4bad-b94d-db5d2a151ccd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.657115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13c7c-c68e-4bad-b94d-db5d2a151ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.667529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7780dbb97d54432971f70f0268dd8cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:44.689626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7780dbb97d54432971f70f0268dd8cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:44.691182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7780dbb97d54432971f70f0268dd8cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:44.697281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-35b13c7c-c68e-4bad-b94d-db5d2a151ccd None None] MFA Rules not processed for user `76ac29b70a38469e9aa851863ffe172e`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:44.698891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-35b13c7c-c68e-4bad-b94d-db5d2a151ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:44.700303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7780dbb97d54432971f70f0268dd8cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:44.720174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3f85eb4a-ce94-42d6-b932-9c45318cd002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7780dbb97d54432971f70f0268dd8cc'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:44.728301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1178/2347] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:44 2022] DELETE /identity/v3/users/c7780dbb97d54432971f70f0268dd8cc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:44.732766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3da18-278e-421e-98c4-b84860805ed4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.733077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3da18-278e-421e-98c4-b84860805ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.733414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3da18-278e-421e-98c4-b84860805ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.752074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cae3da18-278e-421e-98c4-b84860805ed4 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:44.753222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cae3da18-278e-421e-98c4-b84860805ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:44.791043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1170/2348] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:44.796439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13c7c-c68e-4bad-b94d-db5d2a151ccd None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.798348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-35b13c7c-c68e-4bad-b94d-db5d2a151ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:44.851892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1179/2349] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:44.862939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3da18-278e-421e-98c4-b84860805ed4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.865002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cae3da18-278e-421e-98c4-b84860805ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:44.885215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13c7c-c68e-4bad-b94d-db5d2a151ccd None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:44.890220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf2ee0-25f9-47fe-8a3d-3da363615291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:44.891033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2ee0-25f9-47fe-8a3d-3da363615291 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:44.891652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2ee0-25f9-47fe-8a3d-3da363615291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:44.891779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2ee0-25f9-47fe-8a3d-3da363615291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:44.892604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf2ee0-25f9-47fe-8a3d-3da363615291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:44.894782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf2ee0-25f9-47fe-8a3d-3da363615291 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:44.931611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1171/2350] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:44 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:44.932867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf2ee0-25f9-47fe-8a3d-3da363615291 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:44.953611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3da18-278e-421e-98c4-b84860805ed4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.007621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf2ee0-25f9-47fe-8a3d-3da363615291 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.010115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a1bb-ef55-4b58-8286-7ade09d03ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.011032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a1bb-ef55-4b58-8286-7ade09d03ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.011428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a1bb-ef55-4b58-8286-7ade09d03ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.011796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a1bb-ef55-4b58-8286-7ade09d03ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.023716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785756ca-4f34-4bc3-b1ad-dd1c5c21cf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.024549 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785756ca-4f34-4bc3-b1ad-dd1c5c21cf2c admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.026291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785756ca-4f34-4bc3-b1ad-dd1c5c21cf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.026785 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785756ca-4f34-4bc3-b1ad-dd1c5c21cf2c admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.027935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785756ca-4f34-4bc3-b1ad-dd1c5c21cf2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.028167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2a1bb-ef55-4b58-8286-7ade09d03ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.029762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2a1bb-ef55-4b58-8286-7ade09d03ee9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:45.029938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785756ca-4f34-4bc3-b1ad-dd1c5c21cf2c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:45.045579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1180/2351] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:41:45.055446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1172/2352] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:44 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:45.059143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a1bb-ef55-4b58-8286-7ade09d03ee9 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:45.073895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a1bb-ef55-4b58-8286-7ade09d03ee9 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.079027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf307b-17c1-473e-9592-b350405f4b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.081741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf307b-17c1-473e-9592-b350405f4b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.084632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf307b-17c1-473e-9592-b350405f4b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.086451 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf307b-17c1-473e-9592-b350405f4b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.087486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf307b-17c1-473e-9592-b350405f4b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.092883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf307b-17c1-473e-9592-b350405f4b46 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:45.123122 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1181/2353] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:45.128774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785756ca-4f34-4bc3-b1ad-dd1c5c21cf2c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:45.155300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785756ca-4f34-4bc3-b1ad-dd1c5c21cf2c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.161439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864181-124f-44fe-821a-18acb32386a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.162576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864181-124f-44fe-821a-18acb32386a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.162850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864181-124f-44fe-821a-18acb32386a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.163123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864181-124f-44fe-821a-18acb32386a1 admin admin] PATH_INFO: `/v3/projects/37aa60c516fd48d399b36218208c30c2/users/7678d9212fb04700b2dbe5c644ac3995/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.185090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864181-124f-44fe-821a-18acb32386a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37aa60c516fd48d399b36218208c30c2, user_id=7678d9212fb04700b2dbe5c644ac3995, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.189144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864181-124f-44fe-821a-18acb32386a1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:45.218096 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1173/2354] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:45 2022] PUT /identity/v3/projects/37aa60c516fd48d399b36218208c30c2/users/7678d9212fb04700b2dbe5c644ac3995/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:45.222144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf307b-17c1-473e-9592-b350405f4b46 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:45.233263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf307b-17c1-473e-9592-b350405f4b46 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.327490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb95514-b335-48a7-b338-48690e19a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.328718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95514-b335-48a7-b338-48690e19a4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.329000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95514-b335-48a7-b338-48690e19a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.329276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95514-b335-48a7-b338-48690e19a4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.330374 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb95514-b335-48a7-b338-48690e19a4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.332687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb95514-b335-48a7-b338-48690e19a4f2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:45.348897 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1182/2355] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:45.350211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864181-124f-44fe-821a-18acb32386a1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:45.364307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864181-124f-44fe-821a-18acb32386a1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.370357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.371484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.371599 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.372105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] PATH_INFO: `/v3/projects/37aa60c516fd48d399b36218208c30c2/users/7678d9212fb04700b2dbe5c644ac3995/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.374763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=37aa60c516fd48d399b36218208c30c2, user_id=7678d9212fb04700b2dbe5c644ac3995, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.378343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:45.393122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1174/2356] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:45 2022] PUT /identity/v3/projects/37aa60c516fd48d399b36218208c30c2/users/7678d9212fb04700b2dbe5c644ac3995/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:45.405057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b22f-1ec9-4b1e-b701-44a90b6676e3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.405350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b22f-1ec9-4b1e-b701-44a90b6676e3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.405758 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7b22f-1ec9-4b1e-b701-44a90b6676e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.418082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:45.422960 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:45.449929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-47e7b22f-1ec9-4b1e-b701-44a90b6676e3 None None] MFA Rules not processed for user `7678d9212fb04700b2dbe5c644ac3995`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:45.452240 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-47e7b22f-1ec9-4b1e-b701-44a90b6676e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:45.558537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346f975-cbcc-4837-9459-5324fa875edc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.571083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.571603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1183/2357] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:45.576173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.576469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.576749 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] PATH_INFO: `/v3/projects/0128f84887ba4534877574d6e65af28a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.578226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0128f84887ba4534877574d6e65af28a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.580185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:45.583668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7b22f-1ec9-4b1e-b701-44a90b6676e3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:45.585375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-47e7b22f-1ec9-4b1e-b701-44a90b6676e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:45.657324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0128f84887ba4534877574d6e65af28a', 'request_id': 'req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:45.667115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0128f84887ba4534877574d6e65af28a', 'request_id': 'req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:45.680386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7b22f-1ec9-4b1e-b701-44a90b6676e3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.692291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0128f84887ba4534877574d6e65af28a', 'request_id': 'req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:45.718008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] The token cache is being invalidate because project 0128f84887ba4534877574d6e65af28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:45.718008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:45.718364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4bb0feab-b8c0-403a-b9cc-b92b28e13e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:45.721169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1175/2358] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:45 2022] DELETE /identity/v3/projects/0128f84887ba4534877574d6e65af28a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:45.725872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9858-5504-433c-ab2a-9bbc63253b5a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.726426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9858-5504-433c-ab2a-9bbc63253b5a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.733887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9858-5504-433c-ab2a-9bbc63253b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.759801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c14f9858-5504-433c-ab2a-9bbc63253b5a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:45.761410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c14f9858-5504-433c-ab2a-9bbc63253b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:45.776705 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.777627 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.778163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.778468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.780343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:45.895057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1176/2359] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:45.905087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02847745-7837-4c99-b1a8-c2f144c57e11 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.905460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02847745-7837-4c99-b1a8-c2f144c57e11 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.906017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02847745-7837-4c99-b1a8-c2f144c57e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.911390 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.916114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:45.937967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1184/2360] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:45.949954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-02847745-7837-4c99-b1a8-c2f144c57e11 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:45.951730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-02847745-7837-4c99-b1a8-c2f144c57e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:45.962984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1177/2361] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:45.968050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:45.981603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2127-b65b-42f2-b82e-4fe3f0cba32b service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:45.986972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:45.987727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:45.988078 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:45.988424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:45.989238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:45.989661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:45.991373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:46.017187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1185/2362] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:46.018809 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02847745-7837-4c99-b1a8-c2f144c57e11 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:46.030452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02847745-7837-4c99-b1a8-c2f144c57e11 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:46.046405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:46.046623 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34d44-1d5b-4772-8291-84478ec1564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:46.050983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34d44-1d5b-4772-8291-84478ec1564d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.050983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34d44-1d5b-4772-8291-84478ec1564d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.050983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34d44-1d5b-4772-8291-84478ec1564d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.050983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34d44-1d5b-4772-8291-84478ec1564d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:46.051441 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34d44-1d5b-4772-8291-84478ec1564d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:46.053206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:46.086238 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6c754-6f46-4460-8cd9-fe688ead1e85 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:46.091042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:46.091698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.091977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.092288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.094222 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:46.126987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1178/2363] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:46 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:46.131020 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34d44-1d5b-4772-8291-84478ec1564d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:46.172288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:46.174656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:46.187696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1186/2364] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:41:46.206668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34d44-1d5b-4772-8291-84478ec1564d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:46.211605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41ab5-f224-4c71-89d8-7c960cbf816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:46.212351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41ab5-f224-4c71-89d8-7c960cbf816a admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.212631 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41ab5-f224-4c71-89d8-7c960cbf816a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.213187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41ab5-f224-4c71-89d8-7c960cbf816a admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.215038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c41ab5-f224-4c71-89d8-7c960cbf816a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:46.217848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c41ab5-f224-4c71-89d8-7c960cbf816a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:46.250382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1179/2365] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:46 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:46.251666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:46.268540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7de48-0a8f-45f0-bb18-eeb1b1bf1b8a service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:46.277227 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfca4-9dc9-4869-8a40-7b228b559982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:46.277978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfca4-9dc9-4869-8a40-7b228b559982 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.278261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfca4-9dc9-4869-8a40-7b228b559982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.278538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfca4-9dc9-4869-8a40-7b228b559982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.280154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdfca4-9dc9-4869-8a40-7b228b559982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:46.281008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdfca4-9dc9-4869-8a40-7b228b559982 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:46.297112 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1187/2366] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:41:46.301203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41ab5-f224-4c71-89d8-7c960cbf816a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:46.325989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41ab5-f224-4c71-89d8-7c960cbf816a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:46.337003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8185-6013-4e65-94b1-46e60d80e274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:46.337782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8185-6013-4e65-94b1-46e60d80e274 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.338124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8185-6013-4e65-94b1-46e60d80e274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.338479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8185-6013-4e65-94b1-46e60d80e274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.339361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8185-6013-4e65-94b1-46e60d80e274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:46.341092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8185-6013-4e65-94b1-46e60d80e274 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:46.359803 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1180/2367] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:46.361806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfca4-9dc9-4869-8a40-7b228b559982 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:46.375201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfca4-9dc9-4869-8a40-7b228b559982 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:46.386261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:46.387665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.388258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.388674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] PATH_INFO: `/v3/projects/a83ff714966d4251bd771f40a8444b2c/users/8662c7740a1d46358416f2f952a235e3/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.414462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83ff714966d4251bd771f40a8444b2c, user_id=8662c7740a1d46358416f2f952a235e3, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:46.420010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:46.445802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1188/2368] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:46 2022] PUT /identity/v3/projects/a83ff714966d4251bd771f40a8444b2c/users/8662c7740a1d46358416f2f952a235e3/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:46.453123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c8e1-29a4-47f9-ae7d-e1498e0575b3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.453817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c8e1-29a4-47f9-ae7d-e1498e0575b3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.453817 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c8e1-29a4-47f9-ae7d-e1498e0575b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.486294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3db6c8e1-29a4-47f9-ae7d-e1498e0575b3 None None] MFA Rules not processed for user `8662c7740a1d46358416f2f952a235e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:46.487686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3db6c8e1-29a4-47f9-ae7d-e1498e0575b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:46.548785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:46.551270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:46.576953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1181/2369] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:46.632992 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeedd8-4d90-4ac1-9df6-d4354191bfb4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:46.638243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:46.639163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.639529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.639866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] PATH_INFO: `/v3/users/76ac29b70a38469e9aa851863ffe172e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.641174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ac29b70a38469e9aa851863ffe172e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:46.643527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:46.722562 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ac29b70a38469e9aa851863ffe172e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:46.744615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ac29b70a38469e9aa851863ffe172e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:46.745541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ac29b70a38469e9aa851863ffe172e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:46.763586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ac29b70a38469e9aa851863ffe172e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:46.780152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ac29b70a38469e9aa851863ffe172e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:46.790052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1189/2370] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:46 2022] DELETE /identity/v3/users/76ac29b70a38469e9aa851863ffe172e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:46.794657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4fe7-b315-46ef-a8a8-f8ea2ae2aa55 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:46.797196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4fe7-b315-46ef-a8a8-f8ea2ae2aa55 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:46.797655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4fe7-b315-46ef-a8a8-f8ea2ae2aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:46.822819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-733d4fe7-b315-46ef-a8a8-f8ea2ae2aa55 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:46.824510 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-733d4fe7-b315-46ef-a8a8-f8ea2ae2aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:46.925503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1182/2371] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:46.932980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:46.934780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:47.013881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47758-c58c-49f2-a2bd-928c14032b51 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:47.018273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d46aac-a35c-4997-b5f1-2d82d84d5ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:47.019255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d46aac-a35c-4997-b5f1-2d82d84d5ade service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:47.019719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d46aac-a35c-4997-b5f1-2d82d84d5ade service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:47.020239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d46aac-a35c-4997-b5f1-2d82d84d5ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:47.031058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d46aac-a35c-4997-b5f1-2d82d84d5ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:47.033172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d46aac-a35c-4997-b5f1-2d82d84d5ade service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:47.055137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1190/2372] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:47.443087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d4fe7-b315-46ef-a8a8-f8ea2ae2aa55 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:47.444537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-733d4fe7-b315-46ef-a8a8-f8ea2ae2aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:47.459626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d4fe7-b315-46ef-a8a8-f8ea2ae2aa55 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:47.474381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:47.483993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:47.484383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:47.484676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] PATH_INFO: `/v3/projects/ef6307fc70144bb5ab16b147869370ba` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:47.486394 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6307fc70144bb5ab16b147869370ba)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:47.488163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:47.555672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6307fc70144bb5ab16b147869370ba', 'request_id': 'req-26eeb849-6a4d-4466-96f9-4eb86d8dba94'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.563387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6307fc70144bb5ab16b147869370ba', 'request_id': 'req-26eeb849-6a4d-4466-96f9-4eb86d8dba94'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.573972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6307fc70144bb5ab16b147869370ba', 'request_id': 'req-26eeb849-6a4d-4466-96f9-4eb86d8dba94'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.590773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] The token cache is being invalidate because project ef6307fc70144bb5ab16b147869370ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:47.591087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.591700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.593579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1183/2373] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:47 2022] DELETE /identity/v3/projects/ef6307fc70144bb5ab16b147869370ba => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:47.597893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d46aac-a35c-4997-b5f1-2d82d84d5ade service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:47.608650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d46aac-a35c-4997-b5f1-2d82d84d5ade service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:47.698142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:47.699309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:47.700050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:47.702069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] PATH_INFO: `/v3/users/7678d9212fb04700b2dbe5c644ac3995` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:47.709174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7678d9212fb04700b2dbe5c644ac3995)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:47.712796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:47.791334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7678d9212fb04700b2dbe5c644ac3995'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.810023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7678d9212fb04700b2dbe5c644ac3995'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.811093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7678d9212fb04700b2dbe5c644ac3995'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.819980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7678d9212fb04700b2dbe5c644ac3995'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.830455 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7c0dbbf0-3760-4036-9833-ab5a68aee5a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7678d9212fb04700b2dbe5c644ac3995'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:47.837289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1191/2374] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:47 2022] DELETE /identity/v3/users/7678d9212fb04700b2dbe5c644ac3995 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:48.251179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:48.253173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:48.271231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeb849-6a4d-4466-96f9-4eb86d8dba94 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:48.356135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:48.357222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:48.357533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:48.358206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] PATH_INFO: `/v3/projects/37aa60c516fd48d399b36218208c30c2` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:48.362296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37aa60c516fd48d399b36218208c30c2)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:48.362296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:48.432829 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37aa60c516fd48d399b36218208c30c2', 'request_id': 'req-cd51801c-98be-47c9-8a42-162951001f55'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:48.440346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37aa60c516fd48d399b36218208c30c2', 'request_id': 'req-cd51801c-98be-47c9-8a42-162951001f55'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:48.451724 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37aa60c516fd48d399b36218208c30c2', 'request_id': 'req-cd51801c-98be-47c9-8a42-162951001f55'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:48.464193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] The token cache is being invalidate because project 37aa60c516fd48d399b36218208c30c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:48.465184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:48.466040 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd51801c-98be-47c9-8a42-162951001f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:48.467874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1184/2375] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:48 2022] DELETE /identity/v3/projects/37aa60c516fd48d399b36218208c30c2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:48.473717 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e1a1-2293-43b0-99ac-5776b03623e7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:48.474319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e1a1-2293-43b0-99ac-5776b03623e7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:48.475409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e1a1-2293-43b0-99ac-5776b03623e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:48.497615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4cf8e1a1-2293-43b0-99ac-5776b03623e7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:48.498978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4cf8e1a1-2293-43b0-99ac-5776b03623e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:48.593674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1192/2376] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:48.596783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92be09e-73e9-4546-b668-a812871f43e0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:48.597126 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92be09e-73e9-4546-b668-a812871f43e0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:48.597418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92be09e-73e9-4546-b668-a812871f43e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:48.618314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b92be09e-73e9-4546-b668-a812871f43e0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:48.619597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b92be09e-73e9-4546-b668-a812871f43e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:48.628315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1185/2377] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:48.633052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8e1a1-2293-43b0-99ac-5776b03623e7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:48.647462 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8e1a1-2293-43b0-99ac-5776b03623e7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:48.658058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:48.659174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:48.659640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:48.660206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:48.661466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:48.661815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:48.664356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:48.680926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1193/2378] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:41:48.685644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92be09e-73e9-4546-b668-a812871f43e0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:48.704264 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92be09e-73e9-4546-b668-a812871f43e0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:48.722585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964895e-827c-4be0-bf34-67697519f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:48.723326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964895e-827c-4be0-bf34-67697519f347 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:48.723764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964895e-827c-4be0-bf34-67697519f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:48.724049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964895e-827c-4be0-bf34-67697519f347 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:48.724775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964895e-827c-4be0-bf34-67697519f347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:48.727581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964895e-827c-4be0-bf34-67697519f347 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:48.762456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1186/2379] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:48 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:48.766642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:48.780702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46920-1010-4e86-b43f-e245e7de65d5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:48.900481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f18d1-2199-4ecf-89fb-be1dacd78c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:48.902044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f18d1-2199-4ecf-89fb-be1dacd78c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:48.902487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f18d1-2199-4ecf-89fb-be1dacd78c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:48.902934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f18d1-2199-4ecf-89fb-be1dacd78c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:48.904093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f18d1-2199-4ecf-89fb-be1dacd78c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:48.907020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f18d1-2199-4ecf-89fb-be1dacd78c6e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:48.936865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1194/2380] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:48 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:48.941620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964895e-827c-4be0-bf34-67697519f347 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:48.970818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964895e-827c-4be0-bf34-67697519f347 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:48.979862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96b87-9dce-4209-bb6a-658e83d6ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:48.980770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96b87-9dce-4209-bb6a-658e83d6ca8b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:48.981229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96b87-9dce-4209-bb6a-658e83d6ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:48.981710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96b87-9dce-4209-bb6a-658e83d6ca8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:48.982635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d96b87-9dce-4209-bb6a-658e83d6ca8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:48.984515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d96b87-9dce-4209-bb6a-658e83d6ca8b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:49.007679 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1187/2381] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:49.013037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f18d1-2199-4ecf-89fb-be1dacd78c6e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:49.027630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f18d1-2199-4ecf-89fb-be1dacd78c6e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:49.040560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d586a-d83f-4c1f-bb9a-e1f4215c3fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:49.042833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d586a-d83f-4c1f-bb9a-e1f4215c3fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:49.043143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d586a-d83f-4c1f-bb9a-e1f4215c3fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:49.045213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d586a-d83f-4c1f-bb9a-e1f4215c3fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:49.046412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d586a-d83f-4c1f-bb9a-e1f4215c3fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:49.049882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d586a-d83f-4c1f-bb9a-e1f4215c3fa4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:49.094143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96b87-9dce-4209-bb6a-658e83d6ca8b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:49.095937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1195/2382] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:49.107895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96b87-9dce-4209-bb6a-658e83d6ca8b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:49.121210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:49.122362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:49.124412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:49.124774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] PATH_INFO: `/v3/projects/10a0adf240b24b6a92a31f69d26cbbe2/users/a65b43e89d1849bd8ba70b84410a5cb6/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:49.162076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a0adf240b24b6a92a31f69d26cbbe2, user_id=a65b43e89d1849bd8ba70b84410a5cb6, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:49.165344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:49.184248 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1188/2383] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:49 2022] PUT /identity/v3/projects/10a0adf240b24b6a92a31f69d26cbbe2/users/a65b43e89d1849bd8ba70b84410a5cb6/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:41:49.190087 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc62d-092b-4872-9976-d83b1f1d1b7f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:49.190817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc62d-092b-4872-9976-d83b1f1d1b7f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:49.190817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc62d-092b-4872-9976-d83b1f1d1b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:49.228699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d0ebc62d-092b-4872-9976-d83b1f1d1b7f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:49.230585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d0ebc62d-092b-4872-9976-d83b1f1d1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:49.325681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1196/2384] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:49.335475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:49.338279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:49.424491 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370e56e-1561-47bd-adbb-fad22a4abba8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:49.428567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04992778-82f6-42a0-97e3-dc721503fcb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:49.429242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04992778-82f6-42a0-97e3-dc721503fcb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:49.429524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04992778-82f6-42a0-97e3-dc721503fcb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:49.429824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04992778-82f6-42a0-97e3-dc721503fcb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:49.440434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04992778-82f6-42a0-97e3-dc721503fcb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:49.441957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04992778-82f6-42a0-97e3-dc721503fcb8 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:49.461648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1189/2385] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:50.236182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa91a1-db3b-4419-85bb-eb2f680fe233 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:50.236726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa91a1-db3b-4419-85bb-eb2f680fe233 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:50.236726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa91a1-db3b-4419-85bb-eb2f680fe233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:50.264203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3bfa91a1-db3b-4419-85bb-eb2f680fe233 None None] MFA Rules not processed for user `6838738598ce4d2186e7c0b6547868f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:50.265409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3bfa91a1-db3b-4419-85bb-eb2f680fe233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:50.363965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1197/2386] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:50.653579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01727de7-07d5-4b27-8479-c481c9de63a9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:50.654670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01727de7-07d5-4b27-8479-c481c9de63a9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:50.655027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01727de7-07d5-4b27-8479-c481c9de63a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:50.695811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-01727de7-07d5-4b27-8479-c481c9de63a9 None None] MFA Rules not processed for user `a65b43e89d1849bd8ba70b84410a5cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:50.696758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-01727de7-07d5-4b27-8479-c481c9de63a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:50.847018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1190/2387] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:50.851654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa91a1-db3b-4419-85bb-eb2f680fe233 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:50.866790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa91a1-db3b-4419-85bb-eb2f680fe233 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:50.877946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6686d-1721-4244-b573-dddfb5522454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:50.883979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6686d-1721-4244-b573-dddfb5522454 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:50.884340 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6686d-1721-4244-b573-dddfb5522454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:50.884939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6686d-1721-4244-b573-dddfb5522454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:50.886130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6686d-1721-4244-b573-dddfb5522454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:50.888342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6686d-1721-4244-b573-dddfb5522454 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:50.936535 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1198/2388] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:50 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:50.940555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01727de7-07d5-4b27-8479-c481c9de63a9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:50.953422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01727de7-07d5-4b27-8479-c481c9de63a9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:51.017365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98233-4f77-418b-a80f-f88557847949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:51.018488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98233-4f77-418b-a80f-f88557847949 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:51.019004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98233-4f77-418b-a80f-f88557847949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:51.019362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98233-4f77-418b-a80f-f88557847949 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:51.020304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc98233-4f77-418b-a80f-f88557847949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:51.022429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc98233-4f77-418b-a80f-f88557847949 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:51.045333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1191/2389] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:50 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:41:51.051274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6686d-1721-4244-b573-dddfb5522454 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:51.064423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6686d-1721-4244-b573-dddfb5522454 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:51.070939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9bb18-c96d-4530-86ad-7879c5a1ea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:51.071708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9bb18-c96d-4530-86ad-7879c5a1ea1e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:51.071916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9bb18-c96d-4530-86ad-7879c5a1ea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:51.072193 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9bb18-c96d-4530-86ad-7879c5a1ea1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:51.072925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9bb18-c96d-4530-86ad-7879c5a1ea1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:51.074568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9bb18-c96d-4530-86ad-7879c5a1ea1e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:51.090782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1199/2390] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:51.092221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98233-4f77-418b-a80f-f88557847949 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:51.105901 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98233-4f77-418b-a80f-f88557847949 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:51.113916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b238a-2faa-4698-bd77-cfb3c0ffd12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:51.114970 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b238a-2faa-4698-bd77-cfb3c0ffd12f admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:51.115464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b238a-2faa-4698-bd77-cfb3c0ffd12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:51.115799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b238a-2faa-4698-bd77-cfb3c0ffd12f admin admin] PATH_INFO: `/v3/projects/887e2c69c8414b0ba8dc1aca71e63e62/users/3838aecc4da042b2b65b152bd468a69e/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:51.133709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b238a-2faa-4698-bd77-cfb3c0ffd12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=887e2c69c8414b0ba8dc1aca71e63e62, user_id=3838aecc4da042b2b65b152bd468a69e, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:51.136473 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b238a-2faa-4698-bd77-cfb3c0ffd12f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:51.173333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1192/2391] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:51 2022] PUT /identity/v3/projects/887e2c69c8414b0ba8dc1aca71e63e62/users/3838aecc4da042b2b65b152bd468a69e/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:51.174744 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9bb18-c96d-4530-86ad-7879c5a1ea1e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:51.185910 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9bb18-c96d-4530-86ad-7879c5a1ea1e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:51.264572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:51.265982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:51.266442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:51.266886 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:51.267960 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:51.273723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:51.304187 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1200/2392] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:51.307994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b238a-2faa-4698-bd77-cfb3c0ffd12f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:51.325218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b238a-2faa-4698-bd77-cfb3c0ffd12f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:51.330427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c571ab-4ecb-42ef-94f9-58ccbf1c6e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:51.331319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c571ab-4ecb-42ef-94f9-58ccbf1c6e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:51.331601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c571ab-4ecb-42ef-94f9-58ccbf1c6e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:51.331873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c571ab-4ecb-42ef-94f9-58ccbf1c6e49 admin admin] PATH_INFO: `/v3/projects/887e2c69c8414b0ba8dc1aca71e63e62/users/3838aecc4da042b2b65b152bd468a69e/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:51.333858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c571ab-4ecb-42ef-94f9-58ccbf1c6e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887e2c69c8414b0ba8dc1aca71e63e62, user_id=3838aecc4da042b2b65b152bd468a69e, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:51.336543 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c571ab-4ecb-42ef-94f9-58ccbf1c6e49 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:51.347133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1193/2393] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:51 2022] PUT /identity/v3/projects/887e2c69c8414b0ba8dc1aca71e63e62/users/3838aecc4da042b2b65b152bd468a69e/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:51.648159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:51.650778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:51.671613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec267-fc0b-46b5-bee8-4e72614cc7b3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:51.807315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:51.808676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:51.809242 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:51.809878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] PATH_INFO: `/v3/users/65d3bf3c5a7144d18fdcf27305e84118` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:51.813305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d3bf3c5a7144d18fdcf27305e84118)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:51.817057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:51.934592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d3bf3c5a7144d18fdcf27305e84118'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:51.981309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d3bf3c5a7144d18fdcf27305e84118'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:51.984614 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d3bf3c5a7144d18fdcf27305e84118'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:52.002950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d3bf3c5a7144d18fdcf27305e84118'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:52.025276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d3bf3c5a7144d18fdcf27305e84118'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:52.051508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb278-f05c-4c85-9441-ce8892ca7f34 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:52.052103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb278-f05c-4c85-9441-ce8892ca7f34 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:52.052103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb278-f05c-4c85-9441-ce8892ca7f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:52.053656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1201/2394] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:41:51 2022] DELETE /identity/v3/users/65d3bf3c5a7144d18fdcf27305e84118 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:52.109415 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0efdb278-f05c-4c85-9441-ce8892ca7f34 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:52.111232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0efdb278-f05c-4c85-9441-ce8892ca7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:52.226690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1194/2395] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:52.238439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:52.240494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:52.309770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc40586-0285-4e48-ad81-b3930d5d4de3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:52.310058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc40586-0285-4e48-ad81-b3930d5d4de3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:52.310466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc40586-0285-4e48-ad81-b3930d5d4de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:52.374366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3bc40586-0285-4e48-ad81-b3930d5d4de3 None None] MFA Rules not processed for user `3838aecc4da042b2b65b152bd468a69e`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:52.375811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3bc40586-0285-4e48-ad81-b3930d5d4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:52.386362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd31b8-315b-442f-b820-2da7189a91ba admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:52.393663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:52.394709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:52.395596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:52.396037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:52.411752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:52.413956 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:52.436756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1202/2396] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:52.475365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1195/2397] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:52.487223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:52.488814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:52.614896 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85663687-fc77-4ab3-936a-23c892abc7ab service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:52.626305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81d36-8901-4de8-9c9f-d4c7a8e3b476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:52.626598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81d36-8901-4de8-9c9f-d4c7a8e3b476 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:52.626879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81d36-8901-4de8-9c9f-d4c7a8e3b476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:52.627156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81d36-8901-4de8-9c9f-d4c7a8e3b476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:52.629342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ddb81d36-8901-4de8-9c9f-d4c7a8e3b476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:52.785855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81d36-8901-4de8-9c9f-d4c7a8e3b476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:52.787584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81d36-8901-4de8-9c9f-d4c7a8e3b476 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:52.807563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1203/2398] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:52.878315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc40586-0285-4e48-ad81-b3930d5d4de3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:52.880211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3bc40586-0285-4e48-ad81-b3930d5d4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:52.905398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc40586-0285-4e48-ad81-b3930d5d4de3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:52.912336 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:52.913507 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:52.913986 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:52.914493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] PATH_INFO: `/v3/projects/953b60eea24c423d8a8ee89f3f91785f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:52.916405 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953b60eea24c423d8a8ee89f3f91785f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:52.930583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:52.999889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953b60eea24c423d8a8ee89f3f91785f', 'request_id': 'req-50852e73-ff38-4e9b-a8ee-968017aa8504'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:53.007557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953b60eea24c423d8a8ee89f3f91785f', 'request_id': 'req-50852e73-ff38-4e9b-a8ee-968017aa8504'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:53.017592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953b60eea24c423d8a8ee89f3f91785f', 'request_id': 'req-50852e73-ff38-4e9b-a8ee-968017aa8504'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:53.030961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] The token cache is being invalidate because project 953b60eea24c423d8a8ee89f3f91785f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:41:53.031268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:53.032523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50852e73-ff38-4e9b-a8ee-968017aa8504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:41:53.034680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1196/2399] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:41:52 2022] DELETE /identity/v3/projects/953b60eea24c423d8a8ee89f3f91785f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:53.040500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b5a26-fb45-43ac-ad22-2b9e8e6e21c2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.040822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b5a26-fb45-43ac-ad22-2b9e8e6e21c2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.041093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b5a26-fb45-43ac-ad22-2b9e8e6e21c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.064979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9b5b5a26-fb45-43ac-ad22-2b9e8e6e21c2 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:53.066275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9b5b5a26-fb45-43ac-ad22-2b9e8e6e21c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:53.159968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1204/2400] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:53.168608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df40b-0489-4bd7-99bf-dd825f05f0f1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.170370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df40b-0489-4bd7-99bf-dd825f05f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.170908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df40b-0489-4bd7-99bf-dd825f05f0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.194273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cb1df40b-0489-4bd7-99bf-dd825f05f0f1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:53.195775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cb1df40b-0489-4bd7-99bf-dd825f05f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:53.218082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1197/2401] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:41:53.222118 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b5a26-fb45-43ac-ad22-2b9e8e6e21c2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:53.233495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b5a26-fb45-43ac-ad22-2b9e8e6e21c2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:53.242131 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:53.243070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.243398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.243685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.244765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:41:53.245190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:53.246947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:53.260116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1205/2402] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:41:53.265593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1df40b-0489-4bd7-99bf-dd825f05f0f1 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:53.279108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1df40b-0489-4bd7-99bf-dd825f05f0f1 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:53.284559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96d1af-2e87-432c-8bf1-efc423a5a9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:53.285235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96d1af-2e87-432c-8bf1-efc423a5a9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.285519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96d1af-2e87-432c-8bf1-efc423a5a9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.285851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96d1af-2e87-432c-8bf1-efc423a5a9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.286583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96d1af-2e87-432c-8bf1-efc423a5a9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:53.288559 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96d1af-2e87-432c-8bf1-efc423a5a9b2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:53.320819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1198/2403] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:41:53 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:53.325292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:53.335656 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36278a-3a25-4360-a47c-471dbf397d9b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:53.396248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8edf2e-e5bb-43aa-bd16-0a0b0fa6bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:53.396902 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8edf2e-e5bb-43aa-bd16-0a0b0fa6bd87 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.397175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8edf2e-e5bb-43aa-bd16-0a0b0fa6bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.397445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8edf2e-e5bb-43aa-bd16-0a0b0fa6bd87 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.398220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8edf2e-e5bb-43aa-bd16-0a0b0fa6bd87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:53.400268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8edf2e-e5bb-43aa-bd16-0a0b0fa6bd87 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:53.435176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1206/2404] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:41:53 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:41:53.439249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96d1af-2e87-432c-8bf1-efc423a5a9b2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:53.453145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96d1af-2e87-432c-8bf1-efc423a5a9b2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:53.460161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca853bb-4203-4da2-9b48-0341a43b10ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:53.461161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca853bb-4203-4da2-9b48-0341a43b10ef admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.461715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca853bb-4203-4da2-9b48-0341a43b10ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.461971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca853bb-4203-4da2-9b48-0341a43b10ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.463263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca853bb-4203-4da2-9b48-0341a43b10ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:53.465216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca853bb-4203-4da2-9b48-0341a43b10ef admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:53.477602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1199/2405] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:53.481495 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8edf2e-e5bb-43aa-bd16-0a0b0fa6bd87 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:53.493701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8edf2e-e5bb-43aa-bd16-0a0b0fa6bd87 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:53.499684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0d31-220b-436c-9d9d-aee5bb1240cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:53.500548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0d31-220b-436c-9d9d-aee5bb1240cb admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.500894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0d31-220b-436c-9d9d-aee5bb1240cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.501229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0d31-220b-436c-9d9d-aee5bb1240cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.502135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a0d31-220b-436c-9d9d-aee5bb1240cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:53.503773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a0d31-220b-436c-9d9d-aee5bb1240cb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:53.514248 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1207/2406] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:41:53.518914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca853bb-4203-4da2-9b48-0341a43b10ef admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:53.537488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca853bb-4203-4da2-9b48-0341a43b10ef admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:53.543931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:53.545833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.546517 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.546755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] PATH_INFO: `/v3/projects/6b9ec3ed53c944d9a3a98f0ac5fb912b/users/d0cafd26354b442984abe52ab75883cd/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.565182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9ec3ed53c944d9a3a98f0ac5fb912b, user_id=d0cafd26354b442984abe52ab75883cd, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:53.568199 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:53.583659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1200/2407] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:41:53 2022] PUT /identity/v3/projects/6b9ec3ed53c944d9a3a98f0ac5fb912b/users/d0cafd26354b442984abe52ab75883cd/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:53.594254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122230-7ec9-4843-8321-d0008f5bc543 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.594545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122230-7ec9-4843-8321-d0008f5bc543 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.594847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122230-7ec9-4843-8321-d0008f5bc543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.623611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b7122230-7ec9-4843-8321-d0008f5bc543 None None] MFA Rules not processed for user `d0cafd26354b442984abe52ab75883cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:53.624812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b7122230-7ec9-4843-8321-d0008f5bc543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:53.698747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1208/2408] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:53.707414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:53.709271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:53.775159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb1624-ab76-409f-bc3a-6d40fe1ef125 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:53.778806 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bce319-e442-4eba-91d9-fc9806bc1cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:53.779437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bce319-e442-4eba-91d9-fc9806bc1cff service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:53.779711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bce319-e442-4eba-91d9-fc9806bc1cff service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:53.779985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bce319-e442-4eba-91d9-fc9806bc1cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:53.789760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bce319-e442-4eba-91d9-fc9806bc1cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:53.791372 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bce319-e442-4eba-91d9-fc9806bc1cff service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:53.803402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1201/2409] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:54.281234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122230-7ec9-4843-8321-d0008f5bc543 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:54.282802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b7122230-7ec9-4843-8321-d0008f5bc543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:54.295586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122230-7ec9-4843-8321-d0008f5bc543 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:54.299197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:54.299851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:54.300130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:54.300404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:54.302584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:54.373985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:54.375433 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:54.385000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1209/2410] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:41:55.221163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a07e6-aef6-4f3b-a7f7-85cab5f93594 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:55.221163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a07e6-aef6-4f3b-a7f7-85cab5f93594 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:55.221163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a07e6-aef6-4f3b-a7f7-85cab5f93594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:55.239054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7c5a07e6-aef6-4f3b-a7f7-85cab5f93594 None None] MFA Rules not processed for user `d0cafd26354b442984abe52ab75883cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:41:55.240266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7c5a07e6-aef6-4f3b-a7f7-85cab5f93594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:55.252430 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1202/2411] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:41:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:41:56.048616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:56.050372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:56.113048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b8799-f92f-40d5-bd5e-42057eb0c8af service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:56.116830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0ae05-ea75-432a-8e6a-c425b75391be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43278916b971416e80a79077cf0da75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:56.117445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ae05-ea75-432a-8e6a-c425b75391be service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:56.117914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ae05-ea75-432a-8e6a-c425b75391be service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:56.118190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ae05-ea75-432a-8e6a-c425b75391be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:56.120637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f6d0ae05-ea75-432a-8e6a-c425b75391be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:56.185631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0ae05-ea75-432a-8e6a-c425b75391be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:56.187469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0ae05-ea75-432a-8e6a-c425b75391be service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:56.198571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1210/2412] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:41:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:42:08.572112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7611c-c3e3-4d8a-a68b-642ec2b69e05 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:08.573165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7611c-c3e3-4d8a-a68b-642ec2b69e05 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:08.573653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7611c-c3e3-4d8a-a68b-642ec2b69e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:08.606503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-72d7611c-c3e3-4d8a-a68b-642ec2b69e05 None None] MFA Rules not processed for user `c482d82afb734e10a5a11070fcb5f736`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:08.606991 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-72d7611c-c3e3-4d8a-a68b-642ec2b69e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:08.659026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b265c6-a5e0-416a-a943-16ff8d6bbe65 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:08.659996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b265c6-a5e0-416a-a943-16ff8d6bbe65 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:08.660278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b265c6-a5e0-416a-a943-16ff8d6bbe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:08.681953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c4b265c6-a5e0-416a-a943-16ff8d6bbe65 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:08.683830 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c4b265c6-a5e0-416a-a943-16ff8d6bbe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:08.692659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1203/2413] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:08.766312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1211/2414] 10.222.0.58 () {58 vars in 967 bytes} [Mon May 16 17:42:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:08.780395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7611c-c3e3-4d8a-a68b-642ec2b69e05 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:08.782017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-72d7611c-c3e3-4d8a-a68b-642ec2b69e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:08.865695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7611c-c3e3-4d8a-a68b-642ec2b69e05 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:08.870608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:08.871344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:08.871626 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:08.871900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:08.880519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:08.882153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:08.890387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1204/2415] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:42:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:42:10.999081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b265c6-a5e0-416a-a943-16ff8d6bbe65 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:11.000794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c4b265c6-a5e0-416a-a943-16ff8d6bbe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:11.190002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b265c6-a5e0-416a-a943-16ff8d6bbe65 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:11.211934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:11.213004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:11.213420 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:11.213973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] PATH_INFO: `/v3/users/a65b43e89d1849bd8ba70b84410a5cb6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:11.221394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65b43e89d1849bd8ba70b84410a5cb6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:11.223576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:11.360246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65b43e89d1849bd8ba70b84410a5cb6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.411814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65b43e89d1849bd8ba70b84410a5cb6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.412570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65b43e89d1849bd8ba70b84410a5cb6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.427429 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65b43e89d1849bd8ba70b84410a5cb6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.447286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65b43e89d1849bd8ba70b84410a5cb6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.457437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1212/2416] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:42:10 2022] DELETE /identity/v3/users/a65b43e89d1849bd8ba70b84410a5cb6 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:11.523705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:11.526725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:11.554913 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305db4f-546c-4285-b1c3-99fc7625af02 service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:11.659171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:11.660145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:11.660422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:11.660709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] PATH_INFO: `/v3/users/4a557548cbc94c33a1d99d694d6b57c0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:11.663527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a557548cbc94c33a1d99d694d6b57c0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:11.665472 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:11.772268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a557548cbc94c33a1d99d694d6b57c0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.777299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:11.779148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:11.786926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a557548cbc94c33a1d99d694d6b57c0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.788206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a557548cbc94c33a1d99d694d6b57c0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.789379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a557548cbc94c33a1d99d694d6b57c0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.799861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a557548cbc94c33a1d99d694d6b57c0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:11.811935 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f15b9-c1c9-4c08-94f1-8e46bae1e587 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:11.824898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1205/2417] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:42:11 2022] DELETE /identity/v3/users/4a557548cbc94c33a1d99d694d6b57c0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:11.910730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:11.911603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:11.911882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:11.912204 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] PATH_INFO: `/v3/projects/10a0adf240b24b6a92a31f69d26cbbe2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:11.913392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a0adf240b24b6a92a31f69d26cbbe2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:11.915460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:11.991267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a0adf240b24b6a92a31f69d26cbbe2', 'request_id': 'req-98610ff5-fb89-4729-9452-c6950d686c9a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.007441 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a0adf240b24b6a92a31f69d26cbbe2', 'request_id': 'req-98610ff5-fb89-4729-9452-c6950d686c9a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.017144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a0adf240b24b6a92a31f69d26cbbe2', 'request_id': 'req-98610ff5-fb89-4729-9452-c6950d686c9a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.029930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.031371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:12.033430 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] The token cache is being invalidate because project 10a0adf240b24b6a92a31f69d26cbbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:42:12.034058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.034859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.036741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1213/2418] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:42:11 2022] DELETE /identity/v3/projects/10a0adf240b24b6a92a31f69d26cbbe2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:42:12.040651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.042292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:12.070155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abec73-2831-45b9-aaba-a1b733b32c04 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.127767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610ff5-fb89-4729-9452-c6950d686c9a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.135004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.136425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.136847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.137464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] PATH_INFO: `/v3/users/3838aecc4da042b2b65b152bd468a69e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.139020 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3838aecc4da042b2b65b152bd468a69e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.141092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.181820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.182742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.183024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.183295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] PATH_INFO: `/v3/projects/39e8d3ee6d3e40dfbf0d32c7270a42fa` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.184762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e8d3ee6d3e40dfbf0d32c7270a42fa)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.187291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.222450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3838aecc4da042b2b65b152bd468a69e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.239814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3838aecc4da042b2b65b152bd468a69e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.240880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3838aecc4da042b2b65b152bd468a69e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.252536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3838aecc4da042b2b65b152bd468a69e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.261835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af9b488e-efb4-41fa-b2eb-551851be9369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3838aecc4da042b2b65b152bd468a69e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.263611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'request_id': 'req-93454d76-9f82-477f-9a65-43e239d1f204'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.270282 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'request_id': 'req-93454d76-9f82-477f-9a65-43e239d1f204'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.270658 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1214/2419] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:42:12 2022] DELETE /identity/v3/users/3838aecc4da042b2b65b152bd468a69e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:12.283362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'request_id': 'req-93454d76-9f82-477f-9a65-43e239d1f204'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.294647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] The token cache is being invalidate because project 39e8d3ee6d3e40dfbf0d32c7270a42fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:42:12.295143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.295805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93454d76-9f82-477f-9a65-43e239d1f204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.297371 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1206/2420] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:42:12 2022] DELETE /identity/v3/projects/39e8d3ee6d3e40dfbf0d32c7270a42fa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:12.304349 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb692-1757-4524-aba3-d0bd5c4865d8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.304676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb692-1757-4524-aba3-d0bd5c4865d8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.304952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb692-1757-4524-aba3-d0bd5c4865d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.351869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ec4bb692-1757-4524-aba3-d0bd5c4865d8 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:12.353178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ec4bb692-1757-4524-aba3-d0bd5c4865d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:12.413254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1215/2421] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:12.421959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b9e2-20c2-47cf-8801-e5d3b69ca634 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.422247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b9e2-20c2-47cf-8801-e5d3b69ca634 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.422549 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b9e2-20c2-47cf-8801-e5d3b69ca634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.441629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bb692-1757-4524-aba3-d0bd5c4865d8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.443064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ec4bb692-1757-4524-aba3-d0bd5c4865d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:12.443442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7c04b9e2-20c2-47cf-8801-e5d3b69ca634 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:12.444681 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7c04b9e2-20c2-47cf-8801-e5d3b69ca634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:12.453232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1207/2422] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:12.458018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b9e2-20c2-47cf-8801-e5d3b69ca634 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.461096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bb692-1757-4524-aba3-d0bd5c4865d8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.467299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.468059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b9e2-20c2-47cf-8801-e5d3b69ca634 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.468166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.468435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.468710 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] PATH_INFO: `/v3/projects/887e2c69c8414b0ba8dc1aca71e63e62` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.470298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=887e2c69c8414b0ba8dc1aca71e63e62)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.472434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.473994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.474919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.475413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.475840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.477210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:42:12.477989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.480590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.503884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1208/2423] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:42:12.507879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.519857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556eb8c-4590-4d55-b0c0-1c4dc8f9f633 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.534914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887e2c69c8414b0ba8dc1aca71e63e62', 'request_id': 'req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.541360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887e2c69c8414b0ba8dc1aca71e63e62', 'request_id': 'req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.551852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887e2c69c8414b0ba8dc1aca71e63e62', 'request_id': 'req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.563036 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] The token cache is being invalidate because project 887e2c69c8414b0ba8dc1aca71e63e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:42:12.563407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.564078 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a34cef1c-aed9-43fc-8084-cbf6b18c75a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:12.565688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1216/2424] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:42:12 2022] DELETE /identity/v3/projects/887e2c69c8414b0ba8dc1aca71e63e62 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:42:12.570487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77cbd4-13eb-4bff-9d90-56abefd127af None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.570885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77cbd4-13eb-4bff-9d90-56abefd127af None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.571166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77cbd4-13eb-4bff-9d90-56abefd127af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.584068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.584737 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.585044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.585484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.586240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.588186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.595934 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9e77cbd4-13eb-4bff-9d90-56abefd127af None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:12.604746 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9e77cbd4-13eb-4bff-9d90-56abefd127af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:12.614509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1217/2425] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:12.623839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7883-d71d-4867-a44f-4f60ac55d6da None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.624172 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7883-d71d-4867-a44f-4f60ac55d6da None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.624453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7883-d71d-4867-a44f-4f60ac55d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.631296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1209/2426] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:42:12 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:42:12.632389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.634237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:12.645372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-af1e7883-d71d-4867-a44f-4f60ac55d6da None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:12.646757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af1e7883-d71d-4867-a44f-4f60ac55d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:12.732217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c063c4-9ea5-4079-b2c1-fc888e2ead13 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.746259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c94bf-5669-4e10-84cd-da451c90788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.749752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c94bf-5669-4e10-84cd-da451c90788d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.750066 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c94bf-5669-4e10-84cd-da451c90788d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.750906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c94bf-5669-4e10-84cd-da451c90788d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.751635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c94bf-5669-4e10-84cd-da451c90788d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.753276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1218/2427] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:12.755464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c94bf-5669-4e10-84cd-da451c90788d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.757249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7883-d71d-4867-a44f-4f60ac55d6da None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.788274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7883-d71d-4867-a44f-4f60ac55d6da None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.801373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.802506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.803285 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.803737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.804707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:42:12.805573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.809333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.817322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1210/2428] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:42:12 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:42:12.819230 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c94bf-5669-4e10-84cd-da451c90788d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.831157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1219/2429] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:42:12.837152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.840456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c94bf-5669-4e10-84cd-da451c90788d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.846888 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bbc1-2075-4079-9ae5-ce5e1d3ad567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.847711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bbc1-2075-4079-9ae5-ce5e1d3ad567 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.848221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bbc1-2075-4079-9ae5-ce5e1d3ad567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.848574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bbc1-2075-4079-9ae5-ce5e1d3ad567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.849446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824bbc1-2075-4079-9ae5-ce5e1d3ad567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.851977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824bbc1-2075-4079-9ae5-ce5e1d3ad567 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.852649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1ca1-b3ee-49b6-a4ea-032ef33ab439 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.858723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c428c4-d388-432f-a98d-bd38556745e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.860569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c428c4-d388-432f-a98d-bd38556745e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.860798 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c428c4-d388-432f-a98d-bd38556745e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.861134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c428c4-d388-432f-a98d-bd38556745e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.862818 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c428c4-d388-432f-a98d-bd38556745e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.865976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c428c4-d388-432f-a98d-bd38556745e2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.868007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1211/2430] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:42:12.868923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bbc1-2075-4079-9ae5-ce5e1d3ad567 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.883163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bbc1-2075-4079-9ae5-ce5e1d3ad567 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:12.899946 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456769e-a47a-4a4f-bff4-52f317d4988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:12.901389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456769e-a47a-4a4f-bff4-52f317d4988f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:12.901701 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456769e-a47a-4a4f-bff4-52f317d4988f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:12.905034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456769e-a47a-4a4f-bff4-52f317d4988f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:12.907810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456769e-a47a-4a4f-bff4-52f317d4988f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:12.913276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456769e-a47a-4a4f-bff4-52f317d4988f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:12.917070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1220/2431] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:42:12 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:42:12.922412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c428c4-d388-432f-a98d-bd38556745e2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.943684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1212/2432] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:42:12.959824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456769e-a47a-4a4f-bff4-52f317d4988f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:12.988966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456769e-a47a-4a4f-bff4-52f317d4988f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.037234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c428c4-d388-432f-a98d-bd38556745e2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.053361 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342c7a-58c1-4c56-af2b-49306483875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.054079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342c7a-58c1-4c56-af2b-49306483875e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.054366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342c7a-58c1-4c56-af2b-49306483875e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.054637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342c7a-58c1-4c56-af2b-49306483875e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.055380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d342c7a-58c1-4c56-af2b-49306483875e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.057335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d342c7a-58c1-4c56-af2b-49306483875e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.097997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1221/2433] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:42:12 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:42:13.101616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342c7a-58c1-4c56-af2b-49306483875e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.113109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342c7a-58c1-4c56-af2b-49306483875e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.120419 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ce275-b2bf-439c-86a1-5e5b2d1081b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.120732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea37069-f008-4b45-ae94-65aa06d24f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.121587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37069-f008-4b45-ae94-65aa06d24f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.122045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37069-f008-4b45-ae94-65aa06d24f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.122194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ce275-b2bf-439c-86a1-5e5b2d1081b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.122452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ce275-b2bf-439c-86a1-5e5b2d1081b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.122725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ce275-b2bf-439c-86a1-5e5b2d1081b2 admin admin] PATH_INFO: `/v3/projects/4aaf58e817524d0080ea855ecceae6da/users/9a72c49c7adf423484de88a90ad426e5/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.122893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37069-f008-4b45-ae94-65aa06d24f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.123763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea37069-f008-4b45-ae94-65aa06d24f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.125533 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea37069-f008-4b45-ae94-65aa06d24f48 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.136761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1222/2434] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:42:13.140421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea37069-f008-4b45-ae94-65aa06d24f48 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.142786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ce275-b2bf-439c-86a1-5e5b2d1081b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aaf58e817524d0080ea855ecceae6da, user_id=9a72c49c7adf423484de88a90ad426e5, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.146350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ce275-b2bf-439c-86a1-5e5b2d1081b2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.175832 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea37069-f008-4b45-ae94-65aa06d24f48 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.188307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1213/2435] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:42:12 2022] PUT /identity/v3/projects/4aaf58e817524d0080ea855ecceae6da/users/9a72c49c7adf423484de88a90ad426e5/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:13.190034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59367d-d7f1-4186-957a-d28c03daf0c6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.195162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59367d-d7f1-4186-957a-d28c03daf0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.195498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59367d-d7f1-4186-957a-d28c03daf0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.235628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bd59367d-d7f1-4186-957a-d28c03daf0c6 None None] MFA Rules not processed for user `9a72c49c7adf423484de88a90ad426e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:13.236928 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bd59367d-d7f1-4186-957a-d28c03daf0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:13.262349 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339116f5-9eb6-4697-b03f-0650a454ec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.263653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339116f5-9eb6-4697-b03f-0650a454ec6f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.263939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339116f5-9eb6-4697-b03f-0650a454ec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.264993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339116f5-9eb6-4697-b03f-0650a454ec6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.265764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339116f5-9eb6-4697-b03f-0650a454ec6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.269525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339116f5-9eb6-4697-b03f-0650a454ec6f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.288151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1223/2436] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:42:13.292284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339116f5-9eb6-4697-b03f-0650a454ec6f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.316848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339116f5-9eb6-4697-b03f-0650a454ec6f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.322858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b1633-505c-4416-8616-020d4985ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.323763 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1633-505c-4416-8616-020d4985ab68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.324045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1633-505c-4416-8616-020d4985ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.324319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1633-505c-4416-8616-020d4985ab68 admin admin] PATH_INFO: `/v3/projects/e5cb2466cdb94a25b9fba014b95f6cd2/users/3749c06487e94a2c857b3afb30cf2623/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.332512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1214/2437] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:13.344235 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59367d-d7f1-4186-957a-d28c03daf0c6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.346211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bd59367d-d7f1-4186-957a-d28c03daf0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:13.348579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b1633-505c-4416-8616-020d4985ab68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cb2466cdb94a25b9fba014b95f6cd2, user_id=3749c06487e94a2c857b3afb30cf2623, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.351365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b1633-505c-4416-8616-020d4985ab68 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.366560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1224/2438] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:42:13 2022] PUT /identity/v3/projects/e5cb2466cdb94a25b9fba014b95f6cd2/users/3749c06487e94a2c857b3afb30cf2623/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:13.381941 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373ebb-9e67-4ab9-9e14-96480c851ce8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.382383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373ebb-9e67-4ab9-9e14-96480c851ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.382871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373ebb-9e67-4ab9-9e14-96480c851ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.415064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59367d-d7f1-4186-957a-d28c03daf0c6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.415812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d2373ebb-9e67-4ab9-9e14-96480c851ce8 None None] MFA Rules not processed for user `3749c06487e94a2c857b3afb30cf2623`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:13.417226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d2373ebb-9e67-4ab9-9e14-96480c851ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:13.465131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ace1bd-f9a7-4ba3-8eb2-59955fcd9671 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43278916b971416e80a79077cf0da75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.465895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ace1bd-f9a7-4ba3-8eb2-59955fcd9671 service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.466446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ace1bd-f9a7-4ba3-8eb2-59955fcd9671 service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.466734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ace1bd-f9a7-4ba3-8eb2-59955fcd9671 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.484697 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1225/2439] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:13.489343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2373ebb-9e67-4ab9-9e14-96480c851ce8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.531555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ace1bd-f9a7-4ba3-8eb2-59955fcd9671 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.533691 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ace1bd-f9a7-4ba3-8eb2-59955fcd9671 service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.544819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1215/2440] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:42:13.556419 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2373ebb-9e67-4ab9-9e14-96480c851ce8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.562454 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0a58a-71e2-42c9-acee-add1300330cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.566407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0a58a-71e2-42c9-acee-add1300330cf admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.566770 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0a58a-71e2-42c9-acee-add1300330cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.567117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0a58a-71e2-42c9-acee-add1300330cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.567947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0a58a-71e2-42c9-acee-add1300330cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.570073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0a58a-71e2-42c9-acee-add1300330cf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.597646 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1226/2441] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:42:13 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:42:13.601011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ace1bd-f9a7-4ba3-8eb2-59955fcd9671 service glance] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.612326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ace1bd-f9a7-4ba3-8eb2-59955fcd9671 service glance] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.667410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f4c1-9e30-472e-8a31-8a3fc0d9dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.668082 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f4c1-9e30-472e-8a31-8a3fc0d9dd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.668360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f4c1-9e30-472e-8a31-8a3fc0d9dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.668674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f4c1-9e30-472e-8a31-8a3fc0d9dd40 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.669700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691f4c1-9e30-472e-8a31-8a3fc0d9dd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.671863 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691f4c1-9e30-472e-8a31-8a3fc0d9dd40 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.693675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1216/2442] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:42:13 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:42:13.697809 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0a58a-71e2-42c9-acee-add1300330cf admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.708657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0a58a-71e2-42c9-acee-add1300330cf admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.715232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fef89-3d08-407d-afba-42ee772eaaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.716076 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fef89-3d08-407d-afba-42ee772eaaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.716262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fef89-3d08-407d-afba-42ee772eaaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.716544 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fef89-3d08-407d-afba-42ee772eaaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.717267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fef89-3d08-407d-afba-42ee772eaaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.718904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fef89-3d08-407d-afba-42ee772eaaf8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.730271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1227/2443] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:42:13.734878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f4c1-9e30-472e-8a31-8a3fc0d9dd40 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.744774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f4c1-9e30-472e-8a31-8a3fc0d9dd40 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.749569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c8df2-c6ac-4101-87d5-efd81ce6d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.750442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c8df2-c6ac-4101-87d5-efd81ce6d15c admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.750752 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c8df2-c6ac-4101-87d5-efd81ce6d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.751023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c8df2-c6ac-4101-87d5-efd81ce6d15c admin admin] PATH_INFO: `/v3/projects/6fbbcc24152c4f0bafb0a65deb2d38f7/users/d48694c510a543e1a9c62ac7a2c33663/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.765618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c8df2-c6ac-4101-87d5-efd81ce6d15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbbcc24152c4f0bafb0a65deb2d38f7, user_id=d48694c510a543e1a9c62ac7a2c33663, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.768395 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c8df2-c6ac-4101-87d5-efd81ce6d15c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.781349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1217/2444] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:42:13 2022] PUT /identity/v3/projects/6fbbcc24152c4f0bafb0a65deb2d38f7/users/d48694c510a543e1a9c62ac7a2c33663/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:13.785176 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fef89-3d08-407d-afba-42ee772eaaf8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.795313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fef89-3d08-407d-afba-42ee772eaaf8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.853652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d3bd6-b09d-4ee3-af6f-a614206db287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.854326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d3bd6-b09d-4ee3-af6f-a614206db287 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.854607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d3bd6-b09d-4ee3-af6f-a614206db287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.854878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d3bd6-b09d-4ee3-af6f-a614206db287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.855645 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d3bd6-b09d-4ee3-af6f-a614206db287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.857873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d3bd6-b09d-4ee3-af6f-a614206db287 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.870301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1228/2445] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:42:13.871871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c8df2-c6ac-4101-87d5-efd81ce6d15c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:13.881959 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c8df2-c6ac-4101-87d5-efd81ce6d15c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:13.886938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:13.887924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.888578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.888578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] PATH_INFO: `/v3/projects/6fbbcc24152c4f0bafb0a65deb2d38f7/users/d48694c510a543e1a9c62ac7a2c33663/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.890683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbbcc24152c4f0bafb0a65deb2d38f7, user_id=d48694c510a543e1a9c62ac7a2c33663, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:13.893632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:13.904512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1218/2446] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:42:13 2022] PUT /identity/v3/projects/6fbbcc24152c4f0bafb0a65deb2d38f7/users/d48694c510a543e1a9c62ac7a2c33663/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:13.915792 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef74764-f85b-4f94-b7f7-a01d0d89c949 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:13.916085 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef74764-f85b-4f94-b7f7-a01d0d89c949 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:13.916503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef74764-f85b-4f94-b7f7-a01d0d89c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:13.949453 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0ef74764-f85b-4f94-b7f7-a01d0d89c949 None None] MFA Rules not processed for user `d48694c510a543e1a9c62ac7a2c33663`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:13.953862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0ef74764-f85b-4f94-b7f7-a01d0d89c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:14.047652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1229/2447] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:14.059303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:14.060996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:14.118608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dd548-92fd-46e8-85b6-3426b565c596 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:14.122354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100fccc-8292-49ee-a5a8-89fc390babe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:14.123008 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100fccc-8292-49ee-a5a8-89fc390babe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:14.123285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100fccc-8292-49ee-a5a8-89fc390babe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:14.123556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100fccc-8292-49ee-a5a8-89fc390babe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:14.190320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100fccc-8292-49ee-a5a8-89fc390babe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:14.192821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100fccc-8292-49ee-a5a8-89fc390babe7 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:14.225585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1219/2448] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:42:18.484323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef74764-f85b-4f94-b7f7-a01d0d89c949 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:18.486074 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0ef74764-f85b-4f94-b7f7-a01d0d89c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:18.498932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef74764-f85b-4f94-b7f7-a01d0d89c949 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:18.503120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816b090-ab67-408f-a6b8-b81eb5c8fdaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:18.503773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b090-ab67-408f-a6b8-b81eb5c8fdaf service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:18.504055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b090-ab67-408f-a6b8-b81eb5c8fdaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:18.504326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b090-ab67-408f-a6b8-b81eb5c8fdaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:18.514006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b090-ab67-408f-a6b8-b81eb5c8fdaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:18.515447 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b090-ab67-408f-a6b8-b81eb5c8fdaf service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:18.525095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1230/2449] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:42:34.003632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100fccc-8292-49ee-a5a8-89fc390babe7 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:34.073733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100fccc-8292-49ee-a5a8-89fc390babe7 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:34.078852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:34.079722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:34.080000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:34.080269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] PATH_INFO: `/v3/users/3749c06487e94a2c857b3afb30cf2623` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:34.081540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3749c06487e94a2c857b3afb30cf2623)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:34.083512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:34.135359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3749c06487e94a2c857b3afb30cf2623'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.148601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3749c06487e94a2c857b3afb30cf2623'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.149329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3749c06487e94a2c857b3afb30cf2623'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.150094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3749c06487e94a2c857b3afb30cf2623'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.158479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3749c06487e94a2c857b3afb30cf2623'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.175114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1220/2450] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:42:34 2022] DELETE /identity/v3/users/3749c06487e94a2c857b3afb30cf2623 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:34.179721 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca199-b329-48bc-9783-b81eddc0323f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:34.180239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca199-b329-48bc-9783-b81eddc0323f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:34.180352 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca199-b329-48bc-9783-b81eddc0323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:34.197578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e3dca199-b329-48bc-9783-b81eddc0323f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:34.198762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e3dca199-b329-48bc-9783-b81eddc0323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:34.263725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1231/2451] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:34.274339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:34.275757 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:34.369443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca236-9649-474d-86e0-932377d8f7d9 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:34.373662 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a4d13-fad8-4da7-90fa-887a7dda3e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:34.374323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a4d13-fad8-4da7-90fa-887a7dda3e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:34.374604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a4d13-fad8-4da7-90fa-887a7dda3e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:34.374879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a4d13-fad8-4da7-90fa-887a7dda3e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:34.385006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a4d13-fad8-4da7-90fa-887a7dda3e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:34.387117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a4d13-fad8-4da7-90fa-887a7dda3e85 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:34.401285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1221/2452] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:42:34.787295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dca199-b329-48bc-9783-b81eddc0323f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:34.789579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e3dca199-b329-48bc-9783-b81eddc0323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:34.812576 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dca199-b329-48bc-9783-b81eddc0323f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:34.833685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:34.836021 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:34.836298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:34.836820 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] PATH_INFO: `/v3/projects/e5cb2466cdb94a25b9fba014b95f6cd2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:34.838683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5cb2466cdb94a25b9fba014b95f6cd2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:34.841263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:34.898231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5cb2466cdb94a25b9fba014b95f6cd2', 'request_id': 'req-4f3449e2-30a0-4918-b387-86439157ab32'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.904827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5cb2466cdb94a25b9fba014b95f6cd2', 'request_id': 'req-4f3449e2-30a0-4918-b387-86439157ab32'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.914394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5cb2466cdb94a25b9fba014b95f6cd2', 'request_id': 'req-4f3449e2-30a0-4918-b387-86439157ab32'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.926887 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] The token cache is being invalidate because project e5cb2466cdb94a25b9fba014b95f6cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:42:34.927177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.927909 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:34.929597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1232/2453] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:42:34 2022] DELETE /identity/v3/projects/e5cb2466cdb94a25b9fba014b95f6cd2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:34.933755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a4d13-fad8-4da7-90fa-887a7dda3e85 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:34.943563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a4d13-fad8-4da7-90fa-887a7dda3e85 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:35.000490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:35.001373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:35.001690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:35.001966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] PATH_INFO: `/v3/users/d48694c510a543e1a9c62ac7a2c33663` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:35.003155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48694c510a543e1a9c62ac7a2c33663)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:35.005114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:35.051925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48694c510a543e1a9c62ac7a2c33663'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.064907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48694c510a543e1a9c62ac7a2c33663'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.065632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48694c510a543e1a9c62ac7a2c33663'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.066357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48694c510a543e1a9c62ac7a2c33663'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.074907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-eace084a-412f-41fe-9a21-697b53d2c158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48694c510a543e1a9c62ac7a2c33663'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.089592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1222/2454] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:42:34 2022] DELETE /identity/v3/users/d48694c510a543e1a9c62ac7a2c33663 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:35.383130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:35.384563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:35.397841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3449e2-30a0-4918-b387-86439157ab32 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:35.455629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:35.456493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:35.456765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:35.457051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] PATH_INFO: `/v3/projects/6fbbcc24152c4f0bafb0a65deb2d38f7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:35.458245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbbcc24152c4f0bafb0a65deb2d38f7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:35.460184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:35.507043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbbcc24152c4f0bafb0a65deb2d38f7', 'request_id': 'req-b290166b-565e-4c20-b76e-68599287175e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.513302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbbcc24152c4f0bafb0a65deb2d38f7', 'request_id': 'req-b290166b-565e-4c20-b76e-68599287175e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.525851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbbcc24152c4f0bafb0a65deb2d38f7', 'request_id': 'req-b290166b-565e-4c20-b76e-68599287175e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.540163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] The token cache is being invalidate because project 6fbbcc24152c4f0bafb0a65deb2d38f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:42:35.540456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.541991 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:35.544834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1233/2455] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:42:35 2022] DELETE /identity/v3/projects/6fbbcc24152c4f0bafb0a65deb2d38f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:35.901732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dc199-a6c1-4e87-bd87-bb7b283b2865 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:35.902017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dc199-a6c1-4e87-bd87-bb7b283b2865 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:35.902292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dc199-a6c1-4e87-bd87-bb7b283b2865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:35.931612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f27dc199-a6c1-4e87-bd87-bb7b283b2865 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:35.932789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f27dc199-a6c1-4e87-bd87-bb7b283b2865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:35.998432 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1223/2456] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:42:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:36.010862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:36.012434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:36.086523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290166b-565e-4c20-b76e-68599287175e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:36.095516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda24548-c628-4c67-aff8-a43195545be4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:36.096159 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24548-c628-4c67-aff8-a43195545be4 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:36.096438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24548-c628-4c67-aff8-a43195545be4 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:36.096714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24548-c628-4c67-aff8-a43195545be4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:36.108797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda24548-c628-4c67-aff8-a43195545be4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:36.110722 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda24548-c628-4c67-aff8-a43195545be4 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:36.119059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1234/2457] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:42:36.365211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dc199-a6c1-4e87-bd87-bb7b283b2865 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:36.366848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f27dc199-a6c1-4e87-bd87-bb7b283b2865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:36.437573 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dc199-a6c1-4e87-bd87-bb7b283b2865 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:36.442592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:36.443581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:36.444576 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:36.444908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] PATH_INFO: `/v3/users/8662c7740a1d46358416f2f952a235e3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:36.446712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8662c7740a1d46358416f2f952a235e3)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:36.448801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:36.499068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8662c7740a1d46358416f2f952a235e3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:36.511513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8662c7740a1d46358416f2f952a235e3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:36.512358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8662c7740a1d46358416f2f952a235e3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:36.512968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8662c7740a1d46358416f2f952a235e3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:36.520304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8662c7740a1d46358416f2f952a235e3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:36.535315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1224/2458] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:42:36 2022] DELETE /identity/v3/users/8662c7740a1d46358416f2f952a235e3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:36.540010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab93a-9347-476b-b0d3-374911df5e1e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:36.540473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab93a-9347-476b-b0d3-374911df5e1e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:36.540580 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab93a-9347-476b-b0d3-374911df5e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:36.558597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-74bab93a-9347-476b-b0d3-374911df5e1e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:36.559947 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-74bab93a-9347-476b-b0d3-374911df5e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:36.625421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1235/2459] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:36.636642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:36.638187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:36.706280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4f13-d49c-4b83-9cf7-1c765070df14 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:36.706980 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882f42-8048-42d1-8149-d106458814f4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:36.707357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882f42-8048-42d1-8149-d106458814f4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:36.707718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882f42-8048-42d1-8149-d106458814f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:36.710511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:36.711222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:36.711506 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:36.711776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:36.725503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:36.727312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:36.728677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5c882f42-8048-42d1-8149-d106458814f4 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:36.729953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5c882f42-8048-42d1-8149-d106458814f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:36.738500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1225/2460] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:42:36.804284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1236/2461] 10.222.0.58 () {58 vars in 967 bytes} [Mon May 16 17:42:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:36.821048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:36.822770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:36.929162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12ddd-65eb-4426-9ead-d488a729b614 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:36.939029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faec5f-875f-4489-9227-854e9c4124e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:36.940130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faec5f-875f-4489-9227-854e9c4124e7 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:36.940130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faec5f-875f-4489-9227-854e9c4124e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:36.941011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faec5f-875f-4489-9227-854e9c4124e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:36.950356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faec5f-875f-4489-9227-854e9c4124e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:36.951774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faec5f-875f-4489-9227-854e9c4124e7 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:36.961721 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1226/2462] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:42:37.195755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882f42-8048-42d1-8149-d106458814f4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.197865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5c882f42-8048-42d1-8149-d106458814f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:37.215619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882f42-8048-42d1-8149-d106458814f4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.224057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.225006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.225322 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.225678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] PATH_INFO: `/v3/projects/a83ff714966d4251bd771f40a8444b2c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.227055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83ff714966d4251bd771f40a8444b2c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.229483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.255819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463594c-204a-4f96-a146-5cba19128b68 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.256180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463594c-204a-4f96-a146-5cba19128b68 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.256522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463594c-204a-4f96-a146-5cba19128b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.279527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5463594c-204a-4f96-a146-5cba19128b68 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:37.280751 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5463594c-204a-4f96-a146-5cba19128b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:37.281073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83ff714966d4251bd771f40a8444b2c', 'request_id': 'req-61469a97-39b1-41ea-9a82-e139ed1cee45'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:37.287148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83ff714966d4251bd771f40a8444b2c', 'request_id': 'req-61469a97-39b1-41ea-9a82-e139ed1cee45'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:37.295293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83ff714966d4251bd771f40a8444b2c', 'request_id': 'req-61469a97-39b1-41ea-9a82-e139ed1cee45'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:37.306244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] The token cache is being invalidate because project a83ff714966d4251bd771f40a8444b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:42:37.306532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:37.307149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-61469a97-39b1-41ea-9a82-e139ed1cee45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:37.308698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1237/2463] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:42:37 2022] DELETE /identity/v3/projects/a83ff714966d4251bd771f40a8444b2c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:37.313700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a715a5-0f71-4bee-9dc5-76a7619c1203 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.314027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a715a5-0f71-4bee-9dc5-76a7619c1203 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.314309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a715a5-0f71-4bee-9dc5-76a7619c1203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.336416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1227/2464] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:37.341126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-46a715a5-0f71-4bee-9dc5-76a7619c1203 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:37.342355 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46a715a5-0f71-4bee-9dc5-76a7619c1203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:37.349629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463594c-204a-4f96-a146-5cba19128b68 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.351216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5463594c-204a-4f96-a146-5cba19128b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:37.398780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1238/2465] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:37.406787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b52e9-95e8-485d-83c1-bab3885c2093 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.407073 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b52e9-95e8-485d-83c1-bab3885c2093 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.407342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b52e9-95e8-485d-83c1-bab3885c2093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.417186 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463594c-204a-4f96-a146-5cba19128b68 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.422618 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76242-8447-44ec-916f-f80b1414898c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.423261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76242-8447-44ec-916f-f80b1414898c service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.423535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76242-8447-44ec-916f-f80b1414898c service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.423799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76242-8447-44ec-916f-f80b1414898c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.424895 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a63b52e9-95e8-485d-83c1-bab3885c2093 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:37.426088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a63b52e9-95e8-485d-83c1-bab3885c2093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:37.432244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd76242-8447-44ec-916f-f80b1414898c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.433823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd76242-8447-44ec-916f-f80b1414898c service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.433950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1239/2466] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:37.438205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b52e9-95e8-485d-83c1-bab3885c2093 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.442500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1228/2467] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:42:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 17:42:37.447372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b52e9-95e8-485d-83c1-bab3885c2093 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.452126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.452768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.453048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.453323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.454144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:42:37.454445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.456169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.468002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1240/2468] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:42:37.472776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76242-8447-44ec-916f-f80b1414898c service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.483621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76242-8447-44ec-916f-f80b1414898c service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.489374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4172ac-f722-47ca-b842-596686395829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.490158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4172ac-f722-47ca-b842-596686395829 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.490334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4172ac-f722-47ca-b842-596686395829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.490612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4172ac-f722-47ca-b842-596686395829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.491399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4172ac-f722-47ca-b842-596686395829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.493297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4172ac-f722-47ca-b842-596686395829 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.520587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1229/2469] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:42:37 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:42:37.524480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.535402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068de3-df96-47d4-9981-6387015e18d4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.595507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa005a5-a67e-486f-8d48-5281b8a8823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.596306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa005a5-a67e-486f-8d48-5281b8a8823e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.596791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa005a5-a67e-486f-8d48-5281b8a8823e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.597132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa005a5-a67e-486f-8d48-5281b8a8823e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.597955 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa005a5-a67e-486f-8d48-5281b8a8823e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.600370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa005a5-a67e-486f-8d48-5281b8a8823e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.625100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1241/2470] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:42:37 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:42:37.626561 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4172ac-f722-47ca-b842-596686395829 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.637173 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4172ac-f722-47ca-b842-596686395829 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.642640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6dd42-c326-44b0-88fd-9a600da2506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.643440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6dd42-c326-44b0-88fd-9a600da2506c admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.643786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6dd42-c326-44b0-88fd-9a600da2506c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.643973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6dd42-c326-44b0-88fd-9a600da2506c admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.644695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6dd42-c326-44b0-88fd-9a600da2506c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.646401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6dd42-c326-44b0-88fd-9a600da2506c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.660605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1230/2471] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:42:37.662069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa005a5-a67e-486f-8d48-5281b8a8823e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.672472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa005a5-a67e-486f-8d48-5281b8a8823e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.677922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d02a90-6d7e-4ebe-83ef-4ac6b7a05423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.678497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d02a90-6d7e-4ebe-83ef-4ac6b7a05423 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.678760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d02a90-6d7e-4ebe-83ef-4ac6b7a05423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.679098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d02a90-6d7e-4ebe-83ef-4ac6b7a05423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.679970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d02a90-6d7e-4ebe-83ef-4ac6b7a05423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.681440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d02a90-6d7e-4ebe-83ef-4ac6b7a05423 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.695132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1242/2472] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:42:37.696233 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6dd42-c326-44b0-88fd-9a600da2506c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.706682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6dd42-c326-44b0-88fd-9a600da2506c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.711373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c8769-e783-4067-8ed1-0ad1aa3349f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.712266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8769-e783-4067-8ed1-0ad1aa3349f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.712726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8769-e783-4067-8ed1-0ad1aa3349f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.712999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8769-e783-4067-8ed1-0ad1aa3349f9 admin admin] PATH_INFO: `/v3/projects/45011717071f40db98085ac4fc62daef/users/72106e6790d541c5800335692bf6c7c9/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.735649 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c8769-e783-4067-8ed1-0ad1aa3349f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45011717071f40db98085ac4fc62daef, user_id=72106e6790d541c5800335692bf6c7c9, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.740344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c8769-e783-4067-8ed1-0ad1aa3349f9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.754334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1231/2473] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:42:37 2022] PUT /identity/v3/projects/45011717071f40db98085ac4fc62daef/users/72106e6790d541c5800335692bf6c7c9/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:37.764582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6030960-4519-495f-8268-655809352872 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.764873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6030960-4519-495f-8268-655809352872 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.765147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6030960-4519-495f-8268-655809352872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.771700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931e578-df2e-4d38-85ab-9ab444c80705 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.771987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931e578-df2e-4d38-85ab-9ab444c80705 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.772283 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931e578-df2e-4d38-85ab-9ab444c80705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.788807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c931e578-df2e-4d38-85ab-9ab444c80705 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:37.790024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c931e578-df2e-4d38-85ab-9ab444c80705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:37.791312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b6030960-4519-495f-8268-655809352872 None None] MFA Rules not processed for user `72106e6790d541c5800335692bf6c7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:37.792482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b6030960-4519-495f-8268-655809352872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:37.845090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1232/2474] 10.222.0.58 () {58 vars in 967 bytes} [Mon May 16 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:37.857813 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931e578-df2e-4d38-85ab-9ab444c80705 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.861048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1243/2475] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:37.871628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6030960-4519-495f-8268-655809352872 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:37.872965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b6030960-4519-495f-8268-655809352872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:37.922149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931e578-df2e-4d38-85ab-9ab444c80705 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.927367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.928134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.928409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.928674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.936673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.938346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.946108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1233/2476] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:42:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 17:42:37.947319 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6030960-4519-495f-8268-655809352872 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:37.951336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:37.951978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:37.952252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:37.952523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:37.961035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:37.962519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:37.971630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1244/2477] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:42:42.170152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:42.175436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:42.257108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed9cfa-c9c0-4fc3-8e1d-3557fdf77912 service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:42.261531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:42.262435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.262713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.262983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] PATH_INFO: `/v3/users/d0cafd26354b442984abe52ab75883cd` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.264181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0cafd26354b442984abe52ab75883cd)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:42.266196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:42.317324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:42.318786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:42.321032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0cafd26354b442984abe52ab75883cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.333222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0cafd26354b442984abe52ab75883cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.333931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0cafd26354b442984abe52ab75883cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.334532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0cafd26354b442984abe52ab75883cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.341079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f2dc7a68-0ef5-445b-a077-363268361bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0cafd26354b442984abe52ab75883cd'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.354566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1234/2478] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:42:42 2022] DELETE /identity/v3/users/d0cafd26354b442984abe52ab75883cd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:42.359795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daab8a-8392-4a6b-a7fa-66218cf7212e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.360081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daab8a-8392-4a6b-a7fa-66218cf7212e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.360359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daab8a-8392-4a6b-a7fa-66218cf7212e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.377157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-01daab8a-8392-4a6b-a7fa-66218cf7212e None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:42.378518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-01daab8a-8392-4a6b-a7fa-66218cf7212e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:42.379572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e32323-bdad-46d3-9511-0cf52a66e21c service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:42.426016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca99c1-d29a-46c0-a05e-0645f11308c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:42.426690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca99c1-d29a-46c0-a05e-0645f11308c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.426960 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca99c1-d29a-46c0-a05e-0645f11308c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.427230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca99c1-d29a-46c0-a05e-0645f11308c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.429015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f6ca99c1-d29a-46c0-a05e-0645f11308c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:42.435503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1235/2479] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:42.446838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daab8a-8392-4a6b-a7fa-66218cf7212e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:42.448465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-01daab8a-8392-4a6b-a7fa-66218cf7212e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:42.461050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daab8a-8392-4a6b-a7fa-66218cf7212e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:42.464815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:42.465454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.465763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.466034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.475424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:42.477100 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:42.486610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1236/2480] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:42:42.494765 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca99c1-d29a-46c0-a05e-0645f11308c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:42.496202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca99c1-d29a-46c0-a05e-0645f11308c2 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:42.505821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1245/2481] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:42:42.695303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:42.696783 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:42.715572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87dfa-0da4-4966-b0cd-1121afc66fc7 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:42.720677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:42.722274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.722274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.722274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] PATH_INFO: `/v3/projects/6b9ec3ed53c944d9a3a98f0ac5fb912b` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.723322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9ec3ed53c944d9a3a98f0ac5fb912b)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:42.725203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:42.771722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'request_id': 'req-03f16a94-6920-4d35-8174-af38b0a3056a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.778032 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'request_id': 'req-03f16a94-6920-4d35-8174-af38b0a3056a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.786278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'request_id': 'req-03f16a94-6920-4d35-8174-af38b0a3056a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.797375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] The token cache is being invalidate because project 6b9ec3ed53c944d9a3a98f0ac5fb912b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:42:42.797696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.798345 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03f16a94-6920-4d35-8174-af38b0a3056a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:42.800148 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1237/2482] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:42:42 2022] DELETE /identity/v3/projects/6b9ec3ed53c944d9a3a98f0ac5fb912b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:42.804971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8851c3-4a8e-4595-bc3b-7c652413527a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.805253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8851c3-4a8e-4595-bc3b-7c652413527a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.805595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8851c3-4a8e-4595-bc3b-7c652413527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.823313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5f8851c3-4a8e-4595-bc3b-7c652413527a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:42.824518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5f8851c3-4a8e-4595-bc3b-7c652413527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:42.891138 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1246/2483] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:42.899277 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d209dcc-73df-4b87-a0ff-7413580019a4 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.899524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d209dcc-73df-4b87-a0ff-7413580019a4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.899828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d209dcc-73df-4b87-a0ff-7413580019a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.919882 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3d209dcc-73df-4b87-a0ff-7413580019a4 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:42.921091 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3d209dcc-73df-4b87-a0ff-7413580019a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:42.930979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1238/2484] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:42.935424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8851c3-4a8e-4595-bc3b-7c652413527a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:42.945764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8851c3-4a8e-4595-bc3b-7c652413527a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:42.950571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:42.951331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.951615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.951891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.952616 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:42:42.952920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:42.954700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:42.970009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1247/2485] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:42:42.971194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d209dcc-73df-4b87-a0ff-7413580019a4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:42.980715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d209dcc-73df-4b87-a0ff-7413580019a4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:42.985648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c255d0-150f-480a-970d-e11255a69b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:42.986307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c255d0-150f-480a-970d-e11255a69b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:42.986585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c255d0-150f-480a-970d-e11255a69b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:42.986861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c255d0-150f-480a-970d-e11255a69b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:42.987598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c255d0-150f-480a-970d-e11255a69b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:42.989502 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c255d0-150f-480a-970d-e11255a69b2e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:43.015347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1239/2486] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:42:42 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:42:43.019529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:43.029816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df0ac1-af0f-440d-abf5-244804279c19 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:43.084965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863dd2b-9958-4e45-a4b4-2ba580105a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:43.085574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863dd2b-9958-4e45-a4b4-2ba580105a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:43.085878 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863dd2b-9958-4e45-a4b4-2ba580105a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:43.086150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863dd2b-9958-4e45-a4b4-2ba580105a96 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:43.086838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863dd2b-9958-4e45-a4b4-2ba580105a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:43.088913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863dd2b-9958-4e45-a4b4-2ba580105a96 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:43.109585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1248/2487] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:42:43 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:42:43.113600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c255d0-150f-480a-970d-e11255a69b2e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:43.124255 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c255d0-150f-480a-970d-e11255a69b2e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:43.129741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc0523-fc28-4ad4-90b3-84628ee45319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:43.130441 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0523-fc28-4ad4-90b3-84628ee45319 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:43.130714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0523-fc28-4ad4-90b3-84628ee45319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:43.130955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0523-fc28-4ad4-90b3-84628ee45319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:43.131694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc0523-fc28-4ad4-90b3-84628ee45319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:43.133279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc0523-fc28-4ad4-90b3-84628ee45319 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:43.147228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1240/2488] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:42:43.148522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863dd2b-9958-4e45-a4b4-2ba580105a96 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:43.161573 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863dd2b-9958-4e45-a4b4-2ba580105a96 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:43.166663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae8db-db92-4283-b1fa-1ab55bfcebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:43.167392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae8db-db92-4283-b1fa-1ab55bfcebff admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:43.167674 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae8db-db92-4283-b1fa-1ab55bfcebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:43.167950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae8db-db92-4283-b1fa-1ab55bfcebff admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:43.169017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dae8db-db92-4283-b1fa-1ab55bfcebff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:43.170662 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dae8db-db92-4283-b1fa-1ab55bfcebff admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:43.183892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1249/2489] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:42:43.185109 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc0523-fc28-4ad4-90b3-84628ee45319 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:43.196017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc0523-fc28-4ad4-90b3-84628ee45319 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:43.211110 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:43.214558 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:43.214992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:43.215478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] PATH_INFO: `/v3/projects/50daf261b3734624a1d32769dfd12ef8/users/3afd31e39f024c349914ce972a2c14e7/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:43.262369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50daf261b3734624a1d32769dfd12ef8, user_id=3afd31e39f024c349914ce972a2c14e7, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:43.265252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:43.287122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1241/2490] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:42:43 2022] PUT /identity/v3/projects/50daf261b3734624a1d32769dfd12ef8/users/3afd31e39f024c349914ce972a2c14e7/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:43.290714 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba73137-02c5-4d3f-9960-c3edbd8828c3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:43.291069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba73137-02c5-4d3f-9960-c3edbd8828c3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:43.291412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba73137-02c5-4d3f-9960-c3edbd8828c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:43.318745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3ba73137-02c5-4d3f-9960-c3edbd8828c3 None None] MFA Rules not processed for user `3afd31e39f024c349914ce972a2c14e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:43.326190 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3ba73137-02c5-4d3f-9960-c3edbd8828c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:43.392289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1250/2491] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:43.403969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:43.405848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:43.460933 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75812f-2698-4055-8c3c-5479dcb690a8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:43.464967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e076b4-9c4d-4022-b14a-8ff66b9041c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:43.465775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e076b4-9c4d-4022-b14a-8ff66b9041c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:43.466053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e076b4-9c4d-4022-b14a-8ff66b9041c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:43.466322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e076b4-9c4d-4022-b14a-8ff66b9041c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:43.475077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e076b4-9c4d-4022-b14a-8ff66b9041c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:43.476620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e076b4-9c4d-4022-b14a-8ff66b9041c9 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:43.485498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1242/2492] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:42:58.736788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba73137-02c5-4d3f-9960-c3edbd8828c3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:58.738468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3ba73137-02c5-4d3f-9960-c3edbd8828c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:58.829129 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba73137-02c5-4d3f-9960-c3edbd8828c3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:58.835229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82536162-72cb-4f79-bfaa-b87b9e00b1b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02938c77178a4f14a33ff1298775687c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:58.835862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82536162-72cb-4f79-bfaa-b87b9e00b1b6 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:58.836137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82536162-72cb-4f79-bfaa-b87b9e00b1b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:58.836425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82536162-72cb-4f79-bfaa-b87b9e00b1b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:58.838426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-82536162-72cb-4f79-bfaa-b87b9e00b1b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:58.849693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82536162-72cb-4f79-bfaa-b87b9e00b1b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:58.851266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82536162-72cb-4f79-bfaa-b87b9e00b1b6 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:58.860823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1251/2493] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:42:58.955295 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e076b4-9c4d-4022-b14a-8ff66b9041c9 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:59.019089 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e076b4-9c4d-4022-b14a-8ff66b9041c9 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:59.024302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:59.025165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.025440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.025741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] PATH_INFO: `/v3/users/3afd31e39f024c349914ce972a2c14e7` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.026971 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afd31e39f024c349914ce972a2c14e7)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:59.028886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:59.078537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afd31e39f024c349914ce972a2c14e7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.090162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afd31e39f024c349914ce972a2c14e7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.090915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afd31e39f024c349914ce972a2c14e7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.091604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afd31e39f024c349914ce972a2c14e7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.098790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afd31e39f024c349914ce972a2c14e7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.112672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1243/2494] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:42:58 2022] DELETE /identity/v3/users/3afd31e39f024c349914ce972a2c14e7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:59.117583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3012b0f-bdd3-4b33-871e-2d2a00976167 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.117907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3012b0f-bdd3-4b33-871e-2d2a00976167 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.118179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3012b0f-bdd3-4b33-871e-2d2a00976167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.136415 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c3012b0f-bdd3-4b33-871e-2d2a00976167 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:59.137683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c3012b0f-bdd3-4b33-871e-2d2a00976167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:59.197704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1252/2495] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:42:59.207760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:59.209455 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:59.269668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ded79d-3122-4f91-8c8a-00ff69d164a0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:59.274084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4ec82-eed9-44b3-81c4-d9b97dfe442e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:59.274730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ec82-eed9-44b3-81c4-d9b97dfe442e service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.275117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ec82-eed9-44b3-81c4-d9b97dfe442e service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.275396 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ec82-eed9-44b3-81c4-d9b97dfe442e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.285688 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4ec82-eed9-44b3-81c4-d9b97dfe442e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:59.287547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4ec82-eed9-44b3-81c4-d9b97dfe442e service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:59.298293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1244/2496] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:42:59.584164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3012b0f-bdd3-4b33-871e-2d2a00976167 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:59.585859 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c3012b0f-bdd3-4b33-871e-2d2a00976167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:59.600025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3012b0f-bdd3-4b33-871e-2d2a00976167 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:59.605329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:59.606244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.606528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.606761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] PATH_INFO: `/v3/projects/50daf261b3734624a1d32769dfd12ef8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.608002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50daf261b3734624a1d32769dfd12ef8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:59.610011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:59.654712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50daf261b3734624a1d32769dfd12ef8', 'request_id': 'req-6f49a8bc-77f0-4d86-af70-d88e0794be4c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.661071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50daf261b3734624a1d32769dfd12ef8', 'request_id': 'req-6f49a8bc-77f0-4d86-af70-d88e0794be4c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.671205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50daf261b3734624a1d32769dfd12ef8', 'request_id': 'req-6f49a8bc-77f0-4d86-af70-d88e0794be4c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.681414 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] The token cache is being invalidate because project 50daf261b3734624a1d32769dfd12ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:42:59.681724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.682337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6f49a8bc-77f0-4d86-af70-d88e0794be4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:42:59.683877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1253/2497] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:42:59 2022] DELETE /identity/v3/projects/50daf261b3734624a1d32769dfd12ef8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:42:59.689314 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59098-6fc2-4a75-ba29-7aca2ebba7d5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.689627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59098-6fc2-4a75-ba29-7aca2ebba7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.689905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59098-6fc2-4a75-ba29-7aca2ebba7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.706820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-29b59098-6fc2-4a75-ba29-7aca2ebba7d5 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:59.708007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-29b59098-6fc2-4a75-ba29-7aca2ebba7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:59.770930 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1245/2498] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:59.778787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc2572-eba5-421e-9967-8ec45033094c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.779206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc2572-eba5-421e-9967-8ec45033094c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.779348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc2572-eba5-421e-9967-8ec45033094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.801097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-93dc2572-eba5-421e-9967-8ec45033094c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:42:59.802671 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-93dc2572-eba5-421e-9967-8ec45033094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:42:59.812676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1254/2499] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:42:59.817166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59098-6fc2-4a75-ba29-7aca2ebba7d5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:59.827638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59098-6fc2-4a75-ba29-7aca2ebba7d5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:59.833004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:59.833702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.833967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.834236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.834951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:42:59.835252 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:59.836847 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:59.848540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1246/2500] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:42:59.853180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc2572-eba5-421e-9967-8ec45033094c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:59.862815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc2572-eba5-421e-9967-8ec45033094c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:59.868793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3087c-bc7d-4560-9fe7-3094d544a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:59.869435 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3087c-bc7d-4560-9fe7-3094d544a714 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.869750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3087c-bc7d-4560-9fe7-3094d544a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.870012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3087c-bc7d-4560-9fe7-3094d544a714 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.870703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3087c-bc7d-4560-9fe7-3094d544a714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:59.872749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3087c-bc7d-4560-9fe7-3094d544a714 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:42:59.897974 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1255/2501] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:42:59 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:42:59.902157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:42:59.916047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e741b0-6ffd-4368-9b27-356204731205 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:42:59.982526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9c6fb-c601-49f3-ae74-e1245d655f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:42:59.983187 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9c6fb-c601-49f3-ae74-e1245d655f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:42:59.983495 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9c6fb-c601-49f3-ae74-e1245d655f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:42:59.983781 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9c6fb-c601-49f3-ae74-e1245d655f92 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:42:59.984472 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9c6fb-c601-49f3-ae74-e1245d655f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:42:59.986567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9c6fb-c601-49f3-ae74-e1245d655f92 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:00.006231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1247/2502] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:42:59 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:43:00.010401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3087c-bc7d-4560-9fe7-3094d544a714 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:00.021030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3087c-bc7d-4560-9fe7-3094d544a714 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:00.026326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee4c3-930b-4094-b744-e7d2821cf6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:00.027052 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee4c3-930b-4094-b744-e7d2821cf6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:00.027329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee4c3-930b-4094-b744-e7d2821cf6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:00.027602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee4c3-930b-4094-b744-e7d2821cf6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:00.028331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee4c3-930b-4094-b744-e7d2821cf6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:00.029982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee4c3-930b-4094-b744-e7d2821cf6ba admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:00.040915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1256/2503] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:43:00.044988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9c6fb-c601-49f3-ae74-e1245d655f92 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:00.055216 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9c6fb-c601-49f3-ae74-e1245d655f92 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:00.060376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8710b-cbee-4632-a8ca-6659e7e1510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:00.061049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8710b-cbee-4632-a8ca-6659e7e1510c admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:00.061329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8710b-cbee-4632-a8ca-6659e7e1510c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:00.061645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8710b-cbee-4632-a8ca-6659e7e1510c admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:00.062390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8710b-cbee-4632-a8ca-6659e7e1510c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:00.063977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8710b-cbee-4632-a8ca-6659e7e1510c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:00.074107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1248/2504] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:43:00.078498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee4c3-930b-4094-b744-e7d2821cf6ba admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:00.088631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee4c3-930b-4094-b744-e7d2821cf6ba admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:00.093470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:00.094368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:00.094634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:00.094907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] PATH_INFO: `/v3/projects/2a1f3dc604cd46e4961489cd14f66d13/users/fea27ed178c8437697a23591a2163768/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:00.109424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1f3dc604cd46e4961489cd14f66d13, user_id=fea27ed178c8437697a23591a2163768, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:00.112107 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:00.128186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1257/2505] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:43:00 2022] PUT /identity/v3/projects/2a1f3dc604cd46e4961489cd14f66d13/users/fea27ed178c8437697a23591a2163768/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:00.133313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083047-fc1d-404b-93c9-41252139ed17 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:00.133642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083047-fc1d-404b-93c9-41252139ed17 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:00.133925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083047-fc1d-404b-93c9-41252139ed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:00.152740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4a083047-fc1d-404b-93c9-41252139ed17 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:00.154028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4a083047-fc1d-404b-93c9-41252139ed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:00.220973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1249/2506] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:00.230921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:00.232833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:00.292530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6facdde-27bc-4751-be25-fb0140c34f9e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:00.297534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddc827-07e5-4064-bac0-581e2b3118ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:00.298209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddc827-07e5-4064-bac0-581e2b3118ac service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:00.298489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddc827-07e5-4064-bac0-581e2b3118ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:00.298731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddc827-07e5-4064-bac0-581e2b3118ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:00.308241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddc827-07e5-4064-bac0-581e2b3118ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:00.309663 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddc827-07e5-4064-bac0-581e2b3118ac service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:00.319137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1258/2507] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:43:01.542485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083047-fc1d-404b-93c9-41252139ed17 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:01.544238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4a083047-fc1d-404b-93c9-41252139ed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:01.565858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083047-fc1d-404b-93c9-41252139ed17 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:01.571962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:01.573184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:01.573652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:01.574150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] PATH_INFO: `/v3/users/72106e6790d541c5800335692bf6c7c9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:01.575470 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72106e6790d541c5800335692bf6c7c9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:01.577698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:01.633728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72106e6790d541c5800335692bf6c7c9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:01.645515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72106e6790d541c5800335692bf6c7c9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:01.646361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72106e6790d541c5800335692bf6c7c9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:01.647012 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72106e6790d541c5800335692bf6c7c9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:01.655003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72106e6790d541c5800335692bf6c7c9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:01.670657 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1250/2508] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:43:01 2022] DELETE /identity/v3/users/72106e6790d541c5800335692bf6c7c9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:01.676466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c25a8-cf60-4072-82ac-24df4fd29213 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:01.677001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c25a8-cf60-4072-82ac-24df4fd29213 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:01.677292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c25a8-cf60-4072-82ac-24df4fd29213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:01.703327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-750c25a8-cf60-4072-82ac-24df4fd29213 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:01.704863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-750c25a8-cf60-4072-82ac-24df4fd29213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:01.816651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1259/2509] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:01.823150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:01.824663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:01.907062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d64b-6b69-4740-a3b4-7e6dec2bb511 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:01.911354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:01.912062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:01.912341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:01.912811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:01.923687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:01.925115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:01.934807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1251/2510] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:43:02.225644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c25a8-cf60-4072-82ac-24df4fd29213 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:02.227323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-750c25a8-cf60-4072-82ac-24df4fd29213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:02.241833 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c25a8-cf60-4072-82ac-24df4fd29213 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:02.247272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:02.248487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:02.248838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:02.249186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] PATH_INFO: `/v3/projects/45011717071f40db98085ac4fc62daef` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:02.250759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45011717071f40db98085ac4fc62daef)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:02.253056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:02.342175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45011717071f40db98085ac4fc62daef', 'request_id': 'req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:02.349803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45011717071f40db98085ac4fc62daef', 'request_id': 'req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:02.360622 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45011717071f40db98085ac4fc62daef', 'request_id': 'req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:02.388399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] The token cache is being invalidate because project 45011717071f40db98085ac4fc62daef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:43:02.388699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:02.389481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e77cc895-1f1a-414c-ac9a-bd66f6a1785b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:02.391530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1260/2511] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:43:02 2022] DELETE /identity/v3/projects/45011717071f40db98085ac4fc62daef => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:02.963872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:02.965871 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:02.992111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf1e02-a472-4842-872d-594a76e30ba7 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:03.084503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:03.085732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:03.086620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:03.087061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] PATH_INFO: `/v3/users/9a72c49c7adf423484de88a90ad426e5` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:03.089456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a72c49c7adf423484de88a90ad426e5)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:03.093412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:03.165717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a72c49c7adf423484de88a90ad426e5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:03.181103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a72c49c7adf423484de88a90ad426e5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:03.181978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a72c49c7adf423484de88a90ad426e5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:03.182948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a72c49c7adf423484de88a90ad426e5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:03.194496 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a72c49c7adf423484de88a90ad426e5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:03.234045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1252/2512] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:43:02 2022] DELETE /identity/v3/users/9a72c49c7adf423484de88a90ad426e5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:03.241737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c56c1-3caa-4067-9812-7cad58fdf163 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:03.242229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c56c1-3caa-4067-9812-7cad58fdf163 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:03.243001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c56c1-3caa-4067-9812-7cad58fdf163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:03.277800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b19c56c1-3caa-4067-9812-7cad58fdf163 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:03.279672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b19c56c1-3caa-4067-9812-7cad58fdf163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:03.390559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1261/2513] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:03.397315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:03.399006 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:03.476815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5e0bc-2bdd-46e4-9ccc-0bdfc06cdba6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:03.482787 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527c5f2-9341-4a4b-aede-e521560476ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:03.483446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527c5f2-9341-4a4b-aede-e521560476ca service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:03.483720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527c5f2-9341-4a4b-aede-e521560476ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:03.484090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527c5f2-9341-4a4b-aede-e521560476ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:03.493826 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527c5f2-9341-4a4b-aede-e521560476ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:03.495168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527c5f2-9341-4a4b-aede-e521560476ca service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:03.506672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1253/2514] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:43:03.938161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c56c1-3caa-4067-9812-7cad58fdf163 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:03.939615 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b19c56c1-3caa-4067-9812-7cad58fdf163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:03.951357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c56c1-3caa-4067-9812-7cad58fdf163 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:03.957583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:03.958725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:03.959014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:03.959358 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] PATH_INFO: `/v3/projects/4aaf58e817524d0080ea855ecceae6da` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:03.961387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aaf58e817524d0080ea855ecceae6da)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:03.963351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.023926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aaf58e817524d0080ea855ecceae6da', 'request_id': 'req-5e8e22cd-b05f-4272-ab24-3a022000b74a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:04.030280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aaf58e817524d0080ea855ecceae6da', 'request_id': 'req-5e8e22cd-b05f-4272-ab24-3a022000b74a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:04.040949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aaf58e817524d0080ea855ecceae6da', 'request_id': 'req-5e8e22cd-b05f-4272-ab24-3a022000b74a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:04.061789 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] The token cache is being invalidate because project 4aaf58e817524d0080ea855ecceae6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:43:04.062109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:04.062829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5e8e22cd-b05f-4272-ab24-3a022000b74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:04.065287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1262/2515] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:43:03 2022] DELETE /identity/v3/projects/4aaf58e817524d0080ea855ecceae6da => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:04.069988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99607b-f7c7-4ea2-a8eb-bd78cf09ab7c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.070465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99607b-f7c7-4ea2-a8eb-bd78cf09ab7c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.070562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99607b-f7c7-4ea2-a8eb-bd78cf09ab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.090346 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2d99607b-f7c7-4ea2-a8eb-bd78cf09ab7c None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:04.091934 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2d99607b-f7c7-4ea2-a8eb-bd78cf09ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:04.153291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1254/2516] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:04.162241 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a84a-ae50-4385-b62d-f2c4e5bba9d7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.163613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a84a-ae50-4385-b62d-f2c4e5bba9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.164001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a84a-ae50-4385-b62d-f2c4e5bba9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.185966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7c20a84a-ae50-4385-b62d-f2c4e5bba9d7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:04.187931 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7c20a84a-ae50-4385-b62d-f2c4e5bba9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:04.196347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1263/2517] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:43:04.201005 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99607b-f7c7-4ea2-a8eb-bd78cf09ab7c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.211259 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99607b-f7c7-4ea2-a8eb-bd78cf09ab7c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.216443 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.217188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.217531 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.217898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.218816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:43:04.219175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:04.220872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.233818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1255/2518] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:43:04.238186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20a84a-ae50-4385-b62d-f2c4e5bba9d7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.248081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20a84a-ae50-4385-b62d-f2c4e5bba9d7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.253572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20464ec2-53a2-4847-818c-5a6e88c6d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.254304 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20464ec2-53a2-4847-818c-5a6e88c6d6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.254586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20464ec2-53a2-4847-818c-5a6e88c6d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.254855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20464ec2-53a2-4847-818c-5a6e88c6d6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.255597 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20464ec2-53a2-4847-818c-5a6e88c6d6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:04.257582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20464ec2-53a2-4847-818c-5a6e88c6d6e2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.309197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1264/2519] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:43:04 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:43:04.310521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.321388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e430-18a1-402f-afe8-81f7e4841951 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.397382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d2326-3688-4dd7-b310-2b593e17aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.398119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d2326-3688-4dd7-b310-2b593e17aee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.398401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d2326-3688-4dd7-b310-2b593e17aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.398674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d2326-3688-4dd7-b310-2b593e17aee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.399399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d2326-3688-4dd7-b310-2b593e17aee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:04.401335 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d2326-3688-4dd7-b310-2b593e17aee5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.428498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1256/2520] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:43:04 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:43:04.433170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20464ec2-53a2-4847-818c-5a6e88c6d6e2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.451306 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20464ec2-53a2-4847-818c-5a6e88c6d6e2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.463822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b6a41-92b7-498c-8a09-c4261e5adc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.464526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b6a41-92b7-498c-8a09-c4261e5adc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.464807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b6a41-92b7-498c-8a09-c4261e5adc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.465363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b6a41-92b7-498c-8a09-c4261e5adc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.465871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b6a41-92b7-498c-8a09-c4261e5adc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:04.467856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b6a41-92b7-498c-8a09-c4261e5adc10 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.480387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1265/2521] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:43:04.484759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d2326-3688-4dd7-b310-2b593e17aee5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.495574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d2326-3688-4dd7-b310-2b593e17aee5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.500692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af8f0-4359-4a20-9af2-b2bbdb1ada9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.501542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af8f0-4359-4a20-9af2-b2bbdb1ada9b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.501965 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af8f0-4359-4a20-9af2-b2bbdb1ada9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.502181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af8f0-4359-4a20-9af2-b2bbdb1ada9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.502940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0af8f0-4359-4a20-9af2-b2bbdb1ada9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:04.504602 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0af8f0-4359-4a20-9af2-b2bbdb1ada9b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.528268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1257/2522] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:43:04.532965 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b6a41-92b7-498c-8a09-c4261e5adc10 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.545149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b6a41-92b7-498c-8a09-c4261e5adc10 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.551028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.557200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.557591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.557904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] PATH_INFO: `/v3/projects/1ab7064e81fc4aeb9f29e98a51d9d0e3/users/3d76bd5d142b4d56aea9bdf1f89e122d/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.575080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab7064e81fc4aeb9f29e98a51d9d0e3, user_id=3d76bd5d142b4d56aea9bdf1f89e122d, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:04.578155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.594661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1266/2523] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:43:04 2022] PUT /identity/v3/projects/1ab7064e81fc4aeb9f29e98a51d9d0e3/users/3d76bd5d142b4d56aea9bdf1f89e122d/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:04.604834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270f79-c296-45f1-a99d-d5ae93b45bb2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.605263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270f79-c296-45f1-a99d-d5ae93b45bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.605678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270f79-c296-45f1-a99d-d5ae93b45bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.639947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f5270f79-c296-45f1-a99d-d5ae93b45bb2 None None] MFA Rules not processed for user `3d76bd5d142b4d56aea9bdf1f89e122d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:04.641641 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f5270f79-c296-45f1-a99d-d5ae93b45bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:04.721585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1258/2524] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:43:04.732303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.733852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:04.794585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad18857-6afa-40d2-9875-0499610051b4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.798310 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db8a54-9f5d-4476-83df-cfbc44b674d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.798972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db8a54-9f5d-4476-83df-cfbc44b674d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.799253 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db8a54-9f5d-4476-83df-cfbc44b674d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.799527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db8a54-9f5d-4476-83df-cfbc44b674d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.810068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db8a54-9f5d-4476-83df-cfbc44b674d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:04.811666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db8a54-9f5d-4476-83df-cfbc44b674d2 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.822170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1267/2525] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:43:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:43:04.851996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270f79-c296-45f1-a99d-d5ae93b45bb2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.865035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505576-195b-4049-9b3b-9d32a31ce4a0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.865581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505576-195b-4049-9b3b-9d32a31ce4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.866035 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505576-195b-4049-9b3b-9d32a31ce4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.894356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4a505576-195b-4049-9b3b-9d32a31ce4a0 None None] MFA Rules not processed for user `fea27ed178c8437697a23591a2163768`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:04.895594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4a505576-195b-4049-9b3b-9d32a31ce4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:04.933771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270f79-c296-45f1-a99d-d5ae93b45bb2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.940354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.941242 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.941520 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:04.941948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] PATH_INFO: `/v3/users/3d76bd5d142b4d56aea9bdf1f89e122d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:04.943239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d76bd5d142b4d56aea9bdf1f89e122d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:04.945154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:04.970960 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1268/2526] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:04.975704 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505576-195b-4049-9b3b-9d32a31ce4a0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:04.977173 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4a505576-195b-4049-9b3b-9d32a31ce4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:04.992245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505576-195b-4049-9b3b-9d32a31ce4a0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:04.998570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:04.999325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:04.999804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.000079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.000766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.000881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d76bd5d142b4d56aea9bdf1f89e122d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.002748 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:05.014298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d76bd5d142b4d56aea9bdf1f89e122d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.015979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d76bd5d142b4d56aea9bdf1f89e122d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.016740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d76bd5d142b4d56aea9bdf1f89e122d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.024551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57f07c13-c217-425d-bade-dc16d3460a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d76bd5d142b4d56aea9bdf1f89e122d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.031003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1269/2527] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:43:04 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:43:05.034976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:05.036717 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:05.041114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1259/2528] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:43:04 2022] DELETE /identity/v3/users/3d76bd5d142b4d56aea9bdf1f89e122d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:43:05.045841 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdf16-4bc0-4c97-97a3-89b4821bc63b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.046070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdf16-4bc0-4c97-97a3-89b4821bc63b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.046370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdf16-4bc0-4c97-97a3-89b4821bc63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.063059 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-80efdf16-4bc0-4c97-97a3-89b4821bc63b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:05.064245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-80efdf16-4bc0-4c97-97a3-89b4821bc63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:05.102099 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208974-0938-465e-b501-a0a6a2cc75e4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:05.121340 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1260/2529] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:05.131279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdf16-4bc0-4c97-97a3-89b4821bc63b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:05.132673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-80efdf16-4bc0-4c97-97a3-89b4821bc63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:05.158391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af7a21-bd72-4ad4-82ad-95d04a8cd951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:05.159043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af7a21-bd72-4ad4-82ad-95d04a8cd951 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.159326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af7a21-bd72-4ad4-82ad-95d04a8cd951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.159673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af7a21-bd72-4ad4-82ad-95d04a8cd951 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.160366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af7a21-bd72-4ad4-82ad-95d04a8cd951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.162347 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af7a21-bd72-4ad4-82ad-95d04a8cd951 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:05.185958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1270/2530] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:43:05 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:43:05.189489 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af7a21-bd72-4ad4-82ad-95d04a8cd951 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:05.190745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdf16-4bc0-4c97-97a3-89b4821bc63b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:05.194390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c97f-adef-422f-8432-0403490050b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:05.195037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c97f-adef-422f-8432-0403490050b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.195315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c97f-adef-422f-8432-0403490050b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.195589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c97f-adef-422f-8432-0403490050b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.199325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af7a21-bd72-4ad4-82ad-95d04a8cd951 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:05.204015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56b057-9495-4705-aa29-84074738e151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:05.204567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56b057-9495-4705-aa29-84074738e151 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.204845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56b057-9495-4705-aa29-84074738e151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.205049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840c97f-adef-422f-8432-0403490050b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.205158 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56b057-9495-4705-aa29-84074738e151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.205860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56b057-9495-4705-aa29-84074738e151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.206619 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840c97f-adef-422f-8432-0403490050b7 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:05.207456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56b057-9495-4705-aa29-84074738e151 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:05.217150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1261/2531] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:43:05.218370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1271/2532] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:43:05.222301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c97f-adef-422f-8432-0403490050b7 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:05.232241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c97f-adef-422f-8432-0403490050b7 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:05.237286 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec38e94-c8c2-4e6a-b47a-344a6de3b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:05.238309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec38e94-c8c2-4e6a-b47a-344a6de3b00e admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.238659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec38e94-c8c2-4e6a-b47a-344a6de3b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.239088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec38e94-c8c2-4e6a-b47a-344a6de3b00e admin admin] PATH_INFO: `/v3/projects/9794e667071c46f5a45dbfb038b52220/users/e662c8b021b64140a42ce000de0edea0/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.256203 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec38e94-c8c2-4e6a-b47a-344a6de3b00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9794e667071c46f5a45dbfb038b52220, user_id=e662c8b021b64140a42ce000de0edea0, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.259001 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec38e94-c8c2-4e6a-b47a-344a6de3b00e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:05.280902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1262/2533] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:43:05 2022] PUT /identity/v3/projects/9794e667071c46f5a45dbfb038b52220/users/e662c8b021b64140a42ce000de0edea0/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:43:05.285104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56b057-9495-4705-aa29-84074738e151 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:05.296726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56b057-9495-4705-aa29-84074738e151 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:05.360607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:05.361914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.362196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.362472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.363239 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.365051 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:05.379143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1272/2534] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:43:05.383914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec38e94-c8c2-4e6a-b47a-344a6de3b00e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:05.397985 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec38e94-c8c2-4e6a-b47a-344a6de3b00e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:05.411650 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e716fc2-36c1-463d-9a4d-1dfb022f114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:05.413763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716fc2-36c1-463d-9a4d-1dfb022f114e admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.414189 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716fc2-36c1-463d-9a4d-1dfb022f114e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.414556 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e716fc2-36c1-463d-9a4d-1dfb022f114e admin admin] PATH_INFO: `/v3/projects/9794e667071c46f5a45dbfb038b52220/users/e662c8b021b64140a42ce000de0edea0/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.417260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e716fc2-36c1-463d-9a4d-1dfb022f114e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9794e667071c46f5a45dbfb038b52220, user_id=e662c8b021b64140a42ce000de0edea0, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.420527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e716fc2-36c1-463d-9a4d-1dfb022f114e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:05.444488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1263/2535] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:43:05 2022] PUT /identity/v3/projects/9794e667071c46f5a45dbfb038b52220/users/e662c8b021b64140a42ce000de0edea0/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:05.635050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:05.636815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:05.650566 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33bf2a-7979-4304-a20c-d371aa7aa159 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:05.731539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:05.732505 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.732862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.733196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] PATH_INFO: `/v3/projects/1ab7064e81fc4aeb9f29e98a51d9d0e3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.734485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab7064e81fc4aeb9f29e98a51d9d0e3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.736400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:05.785148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab7064e81fc4aeb9f29e98a51d9d0e3', 'request_id': 'req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.791857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab7064e81fc4aeb9f29e98a51d9d0e3', 'request_id': 'req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.801777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab7064e81fc4aeb9f29e98a51d9d0e3', 'request_id': 'req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.825163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] The token cache is being invalidate because project 1ab7064e81fc4aeb9f29e98a51d9d0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:43:05.825454 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.826193 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f5bf6fb-8065-4ab0-9cdc-5964d12ffb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:43:05.828163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1273/2536] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:43:05 2022] DELETE /identity/v3/projects/1ab7064e81fc4aeb9f29e98a51d9d0e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:05.833716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba2161-d301-4454-8600-c3d651516af7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.834198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba2161-d301-4454-8600-c3d651516af7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.834629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba2161-d301-4454-8600-c3d651516af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.863373 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-77ba2161-d301-4454-8600-c3d651516af7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:05.864763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-77ba2161-d301-4454-8600-c3d651516af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:05.929081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1264/2537] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:05.937219 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3031446-707a-4e01-be40-7aa0ca860cd7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.937509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3031446-707a-4e01-be40-7aa0ca860cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.937817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3031446-707a-4e01-be40-7aa0ca860cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.956585 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b3031446-707a-4e01-be40-7aa0ca860cd7 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:05.958057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b3031446-707a-4e01-be40-7aa0ca860cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:05.967130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1274/2538] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:05.971261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba2161-d301-4454-8600-c3d651516af7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:05.981057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba2161-d301-4454-8600-c3d651516af7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:05.986535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:05.987601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:05.987998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:05.988437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:05.989983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:43:05.990607 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:05.992551 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:06.011312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1265/2539] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:43:06.013366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3031446-707a-4e01-be40-7aa0ca860cd7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:06.024302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3031446-707a-4e01-be40-7aa0ca860cd7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:06.030528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c47c4-979d-4475-baa9-1bde238af8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:06.031337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c47c4-979d-4475-baa9-1bde238af8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:06.031938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c47c4-979d-4475-baa9-1bde238af8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:06.032282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c47c4-979d-4475-baa9-1bde238af8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:06.033080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c47c4-979d-4475-baa9-1bde238af8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:06.035369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c47c4-979d-4475-baa9-1bde238af8f1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:06.070581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1275/2540] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:43:06 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:43:06.071850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:06.082552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e128a-7034-40ee-8021-dbe56a47992b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:06.157643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8093d-1270-4d6e-aa8f-684b8833bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:06.158512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8093d-1270-4d6e-aa8f-684b8833bc8a admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:06.158805 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8093d-1270-4d6e-aa8f-684b8833bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:06.159087 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8093d-1270-4d6e-aa8f-684b8833bc8a admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:06.159794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8093d-1270-4d6e-aa8f-684b8833bc8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:06.161911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8093d-1270-4d6e-aa8f-684b8833bc8a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:06.189166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1266/2541] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:43:06 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:43:06.190723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c47c4-979d-4475-baa9-1bde238af8f1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:06.204064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c47c4-979d-4475-baa9-1bde238af8f1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:06.214104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb4a8-c0de-49f0-b60f-eb8701af7f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:06.214803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb4a8-c0de-49f0-b60f-eb8701af7f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:06.215088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb4a8-c0de-49f0-b60f-eb8701af7f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:06.215357 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb4a8-c0de-49f0-b60f-eb8701af7f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:06.216091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdb4a8-c0de-49f0-b60f-eb8701af7f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:06.217749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdb4a8-c0de-49f0-b60f-eb8701af7f74 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:06.229938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1276/2542] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:43:06.234438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8093d-1270-4d6e-aa8f-684b8833bc8a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:06.246304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8093d-1270-4d6e-aa8f-684b8833bc8a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:06.252236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702eeb3-d78f-48f1-83a2-786a0abe32b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:06.253261 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702eeb3-d78f-48f1-83a2-786a0abe32b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:06.254071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702eeb3-d78f-48f1-83a2-786a0abe32b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:06.254411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702eeb3-d78f-48f1-83a2-786a0abe32b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:06.255267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702eeb3-d78f-48f1-83a2-786a0abe32b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:06.256965 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702eeb3-d78f-48f1-83a2-786a0abe32b7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:06.267729 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1267/2543] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:43:06.272368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb4a8-c0de-49f0-b60f-eb8701af7f74 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:06.282199 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb4a8-c0de-49f0-b60f-eb8701af7f74 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:06.287093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:06.288171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:06.288529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:06.288873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] PATH_INFO: `/v3/projects/8e740d27d929404fbc7a4964dab899d0/users/ad9e1d2049fa4330b1f78692e9ab7b10/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:06.305140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e740d27d929404fbc7a4964dab899d0, user_id=ad9e1d2049fa4330b1f78692e9ab7b10, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:06.307888 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:06.322047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1277/2544] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:43:06 2022] PUT /identity/v3/projects/8e740d27d929404fbc7a4964dab899d0/users/ad9e1d2049fa4330b1f78692e9ab7b10/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:43:06.327426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b43d3-22ba-43a1-b4cc-1341db2e7935 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:06.327840 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b43d3-22ba-43a1-b4cc-1341db2e7935 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:06.328204 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b43d3-22ba-43a1-b4cc-1341db2e7935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:06.358448 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-981b43d3-22ba-43a1-b4cc-1341db2e7935 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:06.359745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-981b43d3-22ba-43a1-b4cc-1341db2e7935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:06.428144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1268/2545] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:06.438274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:06.440369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:06.504675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53cd7a-9c62-4a7b-8411-6dd474d52553 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:06.508829 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:06.509534 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:06.510010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:06.510315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:06.523539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:06.525244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:06.537243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1278/2546] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:43:07.530915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47e81e-3234-45fc-b819-f938c4f129a8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:07.531886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47e81e-3234-45fc-b819-f938c4f129a8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:07.532584 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47e81e-3234-45fc-b819-f938c4f129a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:07.590138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-de47e81e-3234-45fc-b819-f938c4f129a8 None None] MFA Rules not processed for user `ad9e1d2049fa4330b1f78692e9ab7b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:07.591800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-de47e81e-3234-45fc-b819-f938c4f129a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:07.708583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1269/2547] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:07.725929 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:07.728623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:07.825308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc46843-deca-4fa3-b6b0-370a31dcf9a1 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:07.829703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe5579-0a2d-406c-8088-abf469b33ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:07.831114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5579-0a2d-406c-8088-abf469b33ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:07.831397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5579-0a2d-406c-8088-abf469b33ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:07.831672 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5579-0a2d-406c-8088-abf469b33ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:07.841194 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe5579-0a2d-406c-8088-abf469b33ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:07.842753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe5579-0a2d-406c-8088-abf469b33ba7 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:07.858499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1279/2548] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:43:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:43:09.311732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797bc38-08f5-4b12-bd17-088b51f62809 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:09.312830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797bc38-08f5-4b12-bd17-088b51f62809 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:09.313304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797bc38-08f5-4b12-bd17-088b51f62809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:09.352326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a797bc38-08f5-4b12-bd17-088b51f62809 None None] MFA Rules not processed for user `ad9e1d2049fa4330b1f78692e9ab7b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:09.353791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a797bc38-08f5-4b12-bd17-088b51f62809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:09.372340 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1270/2549] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:10.957387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a5b4-4e93-4fd0-b0f6-3f271219b849 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:10.958019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a5b4-4e93-4fd0-b0f6-3f271219b849 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:10.958019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a5b4-4e93-4fd0-b0f6-3f271219b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:10.987203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7b47a5b4-4e93-4fd0-b0f6-3f271219b849 None None] MFA Rules not processed for user `e662c8b021b64140a42ce000de0edea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:10.988482 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7b47a5b4-4e93-4fd0-b0f6-3f271219b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:11.059574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1280/2550] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:11.072861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797bc38-08f5-4b12-bd17-088b51f62809 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:11.074364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a797bc38-08f5-4b12-bd17-088b51f62809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:11.163912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797bc38-08f5-4b12-bd17-088b51f62809 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:11.167575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43278916b971416e80a79077cf0da75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:11.168537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:11.168814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:11.169255 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:11.171094 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:11.236005 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:11.237527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:11.249317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1271/2551] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:43:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:43:11.364273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be476f-6e74-44ee-89da-54b320127ccb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:11.364558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be476f-6e74-44ee-89da-54b320127ccb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:11.364825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be476f-6e74-44ee-89da-54b320127ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:11.420797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-70be476f-6e74-44ee-89da-54b320127ccb None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:11.422068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-70be476f-6e74-44ee-89da-54b320127ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:11.486843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1281/2552] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:43:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:43:11.511601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:11.513121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:11.605492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f475c-fa6d-42e8-9a56-bb3253a829cf service glance] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:11.615667 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72ba5b-7fe4-4651-ad3a-0bc62209f73c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:11.616332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ba5b-7fe4-4651-ad3a-0bc62209f73c service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:11.616616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ba5b-7fe4-4651-ad3a-0bc62209f73c service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:11.616896 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ba5b-7fe4-4651-ad3a-0bc62209f73c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:11.633322 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ba5b-7fe4-4651-ad3a-0bc62209f73c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:11.635080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ba5b-7fe4-4651-ad3a-0bc62209f73c service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:11.646224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1272/2553] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:43:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:43:21.275327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab305-806c-4110-b446-977b33e03156 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:21.276229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab305-806c-4110-b446-977b33e03156 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:21.276510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab305-806c-4110-b446-977b33e03156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:21.294292 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e38ab305-806c-4110-b446-977b33e03156 None None] MFA Rules not processed for user `fea27ed178c8437697a23591a2163768`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:21.295675 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e38ab305-806c-4110-b446-977b33e03156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:21.303981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1282/2554] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:28.618587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535e7d2-ed4f-4c89-aaea-fec64896400b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:28.619069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535e7d2-ed4f-4c89-aaea-fec64896400b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:28.619153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535e7d2-ed4f-4c89-aaea-fec64896400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:28.639514 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0535e7d2-ed4f-4c89-aaea-fec64896400b None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:28.640739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0535e7d2-ed4f-4c89-aaea-fec64896400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:28.649003 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1273/2555] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:43:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:43:28.661127 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ab305-806c-4110-b446-977b33e03156 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:43:28.672932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ab305-806c-4110-b446-977b33e03156 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:43:28.677806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:43:28.678532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:28.679068 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:28.679399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:28.687914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:43:28.689680 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:43:28.698569 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1283/2556] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:43:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 17:43:46.362439 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498003d-cf2d-476f-8c37-f043811f39b7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:43:46.363076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498003d-cf2d-476f-8c37-f043811f39b7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:43:46.363076 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498003d-cf2d-476f-8c37-f043811f39b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:43:46.380358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1498003d-cf2d-476f-8c37-f043811f39b7 None None] MFA Rules not processed for user `6838738598ce4d2186e7c0b6547868f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:43:46.381527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1498003d-cf2d-476f-8c37-f043811f39b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:43:46.438755 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1274/2557] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:43:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:44:02.138202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:44:02.139796 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:44:02.152507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f96e2-d149-4b1c-94b8-8a5ebab73096 service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:44:02.157578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1db90-d87b-4f19-a404-60ecb346ce1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:44:02.158377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1db90-d87b-4f19-a404-60ecb346ce1e service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:44:02.158653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1db90-d87b-4f19-a404-60ecb346ce1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:44:02.158923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1db90-d87b-4f19-a404-60ecb346ce1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:44:02.168215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1db90-d87b-4f19-a404-60ecb346ce1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:44:02.169813 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1db90-d87b-4f19-a404-60ecb346ce1e service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:44:02.179267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1284/2558] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:44:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:44:09.932666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c66b-5f28-41d5-873b-f24c29939c77 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:44:09.933263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c66b-5f28-41d5-873b-f24c29939c77 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:44:09.933263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c66b-5f28-41d5-873b-f24c29939c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:44:09.950849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ac04c66b-5f28-41d5-873b-f24c29939c77 None None] MFA Rules not processed for user `c482d82afb734e10a5a11070fcb5f736`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:44:09.952017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ac04c66b-5f28-41d5-873b-f24c29939c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:44:10.020577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1275/2559] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:44:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:44:24.890678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698726-42e2-4b37-a597-c43cbd084b7f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:44:24.891226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698726-42e2-4b37-a597-c43cbd084b7f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:44:24.891226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698726-42e2-4b37-a597-c43cbd084b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:44:24.910594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c6698726-42e2-4b37-a597-c43cbd084b7f None None] MFA Rules not processed for user `ad9e1d2049fa4330b1f78692e9ab7b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:44:24.911777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c6698726-42e2-4b37-a597-c43cbd084b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:44:24.920459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1285/2560] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:44:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:44:55.258229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04c66b-5f28-41d5-873b-f24c29939c77 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:44:55.268945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04c66b-5f28-41d5-873b-f24c29939c77 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:44:55.272945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9f090-1f5e-4179-857d-65f11421fb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:44:55.273634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9f090-1f5e-4179-857d-65f11421fb54 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:44:55.273907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9f090-1f5e-4179-857d-65f11421fb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:44:55.274184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9f090-1f5e-4179-857d-65f11421fb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:44:55.276044 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dbd9f090-1f5e-4179-857d-65f11421fb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:44:55.372157 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9f090-1f5e-4179-857d-65f11421fb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:44:55.374413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9f090-1f5e-4179-857d-65f11421fb54 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:44:55.398359 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1276/2561] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:44:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:44:55.457784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6698726-42e2-4b37-a597-c43cbd084b7f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:44:55.467683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6698726-42e2-4b37-a597-c43cbd084b7f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:44:55.471464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df9c0d-6e2d-4772-9b29-410d5ac022df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:44:55.472752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df9c0d-6e2d-4772-9b29-410d5ac022df service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:44:55.473030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df9c0d-6e2d-4772-9b29-410d5ac022df service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:44:55.473291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df9c0d-6e2d-4772-9b29-410d5ac022df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:44:55.475113 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f9df9c0d-6e2d-4772-9b29-410d5ac022df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:44:55.488577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df9c0d-6e2d-4772-9b29-410d5ac022df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:44:55.490029 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df9c0d-6e2d-4772-9b29-410d5ac022df service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:44:55.500873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1286/2562] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:44:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:07.445832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843cab-0884-4cc1-9024-07100032c01a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:07.446313 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843cab-0884-4cc1-9024-07100032c01a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:07.446782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843cab-0884-4cc1-9024-07100032c01a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:07.448079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1277/2563] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:45:07.455018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5af441-9116-4f40-88dd-7e2bde1b3fec None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:07.455523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5af441-9116-4f40-88dd-7e2bde1b3fec None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:07.455523 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5af441-9116-4f40-88dd-7e2bde1b3fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:07.475760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-aa5af441-9116-4f40-88dd-7e2bde1b3fec None None] MFA Rules not processed for user `2fddf039f65a4cff95c9c2041dd81ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:07.476928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aa5af441-9116-4f40-88dd-7e2bde1b3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:07.484851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1287/2564] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:45:07.497772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67843cab-0884-4cc1-9024-07100032c01a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:07.508800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67843cab-0884-4cc1-9024-07100032c01a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:07.513293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e7d84-46af-4964-9b1b-c2acf3459a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:07.514063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7d84-46af-4964-9b1b-c2acf3459a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:07.514376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7d84-46af-4964-9b1b-c2acf3459a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:07.514879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7d84-46af-4964-9b1b-c2acf3459a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:07.525153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e7d84-46af-4964-9b1b-c2acf3459a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:07.527339 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e7d84-46af-4964-9b1b-c2acf3459a24 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:07.539272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1278/2565] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:45:07.637294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6bb3-7715-4f31-a1ee-09820bc257bd None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:07.637676 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6bb3-7715-4f31-a1ee-09820bc257bd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:07.637867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6bb3-7715-4f31-a1ee-09820bc257bd None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:07.639474 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1288/2566] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:45:07.645461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90b9fe-be91-4da1-8ad6-75533ea922f9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:07.645835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90b9fe-be91-4da1-8ad6-75533ea922f9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:07.646180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90b9fe-be91-4da1-8ad6-75533ea922f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:07.682978 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ee90b9fe-be91-4da1-8ad6-75533ea922f9 None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:07.684327 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ee90b9fe-be91-4da1-8ad6-75533ea922f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:07.694675 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1279/2567] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:45:07.705281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b6bb3-7715-4f31-a1ee-09820bc257bd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:07.716432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b6bb3-7715-4f31-a1ee-09820bc257bd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:07.720132 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd685707-ea4a-42ee-8035-4cb60da55b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:07.720774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685707-ea4a-42ee-8035-4cb60da55b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:07.721054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685707-ea4a-42ee-8035-4cb60da55b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:07.721330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685707-ea4a-42ee-8035-4cb60da55b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:07.731320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd685707-ea4a-42ee-8035-4cb60da55b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:07.732857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd685707-ea4a-42ee-8035-4cb60da55b99 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:07.743458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1289/2568] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:07.807481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90b9fe-be91-4da1-8ad6-75533ea922f9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:07.809164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ee90b9fe-be91-4da1-8ad6-75533ea922f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:07.881696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90b9fe-be91-4da1-8ad6-75533ea922f9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:07.887881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02938c77178a4f14a33ff1298775687c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:07.888542 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:07.888818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:07.889086 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:07.891168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:07.904275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:07.905843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:07.916515 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1280/2569] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:09.726938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd685707-ea4a-42ee-8035-4cb60da55b99 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:09.741053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd685707-ea4a-42ee-8035-4cb60da55b99 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:09.745583 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:09.746265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:09.746545 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:09.746815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:09.749000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:09.760549 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:09.762028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:09.771487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1290/2570] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:09.901164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:09.902989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:09.919694 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcf71-768e-4f8a-89f7-4dffd6cce04a service placement] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:09.925661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:09.926315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:09.926568 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:09.926867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:09.928956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:09.940038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:09.941767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:09.951038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1281/2571] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:14.217166 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:14.232713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab532f-2871-4052-b5b4-5dc04545e2bf service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:14.238715 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:14.241669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:14.241669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:14.241669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:14.242343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:14.254632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:14.256272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:14.268530 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1291/2572] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:14.298084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:14.311413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd38ad-30a7-41ec-8536-21cda8d99662 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:14.319486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:14.320577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:14.320844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:14.322754 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:14.327069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:14.344165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:14.346128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:14.366185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1282/2573] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:23.847397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:23.860513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f00e-16e0-43ff-928e-e47d40b27955 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:23.867556 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:23.868409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:23.868989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:23.869295 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] PATH_INFO: `/v3/users/ad9e1d2049fa4330b1f78692e9ab7b10` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:23.870721 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9e1d2049fa4330b1f78692e9ab7b10)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:23.872654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:23.930870 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9e1d2049fa4330b1f78692e9ab7b10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:23.943236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9e1d2049fa4330b1f78692e9ab7b10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:23.944032 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9e1d2049fa4330b1f78692e9ab7b10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:23.951099 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9e1d2049fa4330b1f78692e9ab7b10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:23.961817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-b2091b96-edc1-4eee-92f0-75fdbc0f9230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9e1d2049fa4330b1f78692e9ab7b10'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:23.968455 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1292/2574] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:45:23 2022] DELETE /identity/v3/users/ad9e1d2049fa4330b1f78692e9ab7b10 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:45:24.345192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:24.345904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85f15-f2d4-4ac1-8ea9-6f77ad448bf3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:24.346368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85f15-f2d4-4ac1-8ea9-6f77ad448bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:24.346815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85f15-f2d4-4ac1-8ea9-6f77ad448bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:24.357437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80845b-a5b0-45f7-8aab-80fad0c4f16d service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:24.375499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-78f85f15-f2d4-4ac1-8ea9-6f77ad448bf3 None None] MFA Rules not processed for user `6838738598ce4d2186e7c0b6547868f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:24.376732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-78f85f15-f2d4-4ac1-8ea9-6f77ad448bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:24.418938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:24.419722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:24.419996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:24.420289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] PATH_INFO: `/v3/projects/8e740d27d929404fbc7a4964dab899d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:24.421485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e740d27d929404fbc7a4964dab899d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:24.423392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:24.431612 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1293/2575] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:45:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:45:24.469305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e740d27d929404fbc7a4964dab899d0', 'request_id': 'req-0f90612d-8736-4653-aed0-837d904f6257'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:24.476218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e740d27d929404fbc7a4964dab899d0', 'request_id': 'req-0f90612d-8736-4653-aed0-837d904f6257'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:24.483319 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e740d27d929404fbc7a4964dab899d0', 'request_id': 'req-0f90612d-8736-4653-aed0-837d904f6257'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:24.495188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] The token cache is being invalidate because project 8e740d27d929404fbc7a4964dab899d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:45:24.495628 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:24.496263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:24.497899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1283/2576] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:45:24 2022] DELETE /identity/v3/projects/8e740d27d929404fbc7a4964dab899d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:45:24.742651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f85f15-f2d4-4ac1-8ea9-6f77ad448bf3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:24.744143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-78f85f15-f2d4-4ac1-8ea9-6f77ad448bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:24.800030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f85f15-f2d4-4ac1-8ea9-6f77ad448bf3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:24.854745 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:24.855371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:24.855666 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:24.855937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:24.858307 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:24.868525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:24.870014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:24.878437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1294/2577] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:27.394671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:27.396246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:27.478385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90612d-8736-4653-aed0-837d904f6257 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:27.485025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:27.485723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:27.486009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:27.486282 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:27.488912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:27.506532 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:27.508341 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:27.521104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1284/2578] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:28.807785 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:28.809332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:28.821510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eac86-4947-49e3-b374-6cef0c629567 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:28.826152 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:28.826971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:28.827333 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:28.827707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:28.829797 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:28.957311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:28.963918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:28.984452 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1295/2579] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:32.613917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:32.615621 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:32.630361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202f1f1-fe1f-400c-a884-3a5ccc003165 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:32.635061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:32.635924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:32.636206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:32.636498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] PATH_INFO: `/v3/users/c482d82afb734e10a5a11070fcb5f736` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:32.637815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c482d82afb734e10a5a11070fcb5f736)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:32.639705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:32.687267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c482d82afb734e10a5a11070fcb5f736'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:32.699796 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c482d82afb734e10a5a11070fcb5f736'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:32.700500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c482d82afb734e10a5a11070fcb5f736'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:32.701111 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c482d82afb734e10a5a11070fcb5f736'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:32.707830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1a44bb22-c039-4d06-ac0c-ee18b0fbfb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c482d82afb734e10a5a11070fcb5f736'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:32.724588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1285/2580] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:45:32 2022] DELETE /identity/v3/users/c482d82afb734e10a5a11070fcb5f736 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:45:32.910821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:32.920987 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c639130-8da4-454a-937c-11484d1d28f9 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:32.979761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:32.980640 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:32.980914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:32.981188 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] PATH_INFO: `/v3/projects/1eddf9ae85b940b8bd556f4cf66c0b79` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:32.982442 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eddf9ae85b940b8bd556f4cf66c0b79)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:32.984381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.031195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eddf9ae85b940b8bd556f4cf66c0b79', 'request_id': 'req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:33.037014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eddf9ae85b940b8bd556f4cf66c0b79', 'request_id': 'req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:33.046071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eddf9ae85b940b8bd556f4cf66c0b79', 'request_id': 'req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:33.055952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] The token cache is being invalidate because project 1eddf9ae85b940b8bd556f4cf66c0b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:45:33.056174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:33.056799 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67fc4c1e-60fd-49ef-9a3f-fd7ca74320c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:33.058373 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1296/2581] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:45:32 2022] DELETE /identity/v3/projects/1eddf9ae85b940b8bd556f4cf66c0b79 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:45:33.063324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebd8dd-9def-48b2-9a0f-004e9e4036fa None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.063604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebd8dd-9def-48b2-9a0f-004e9e4036fa None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.063880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebd8dd-9def-48b2-9a0f-004e9e4036fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.081777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-38ebd8dd-9def-48b2-9a0f-004e9e4036fa None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:33.082972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-38ebd8dd-9def-48b2-9a0f-004e9e4036fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:33.144620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1286/2582] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:45:33.152109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de289-6c07-4e08-929c-50be202c0904 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.152393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de289-6c07-4e08-929c-50be202c0904 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.152978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de289-6c07-4e08-929c-50be202c0904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.172490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8d8de289-6c07-4e08-929c-50be202c0904 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:33.173728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8d8de289-6c07-4e08-929c-50be202c0904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:33.181757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1297/2583] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:45:33.186194 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebd8dd-9def-48b2-9a0f-004e9e4036fa None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:33.195981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebd8dd-9def-48b2-9a0f-004e9e4036fa None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:33.205720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:33.206393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.206680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.207022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.207764 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:45:33.208099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:33.209730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.221630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1287/2584] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:45:33.226202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de289-6c07-4e08-929c-50be202c0904 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:33.235425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de289-6c07-4e08-929c-50be202c0904 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:33.240446 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa949611-1ec7-4e7a-beeb-4b94e65d87de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:33.241084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa949611-1ec7-4e7a-beeb-4b94e65d87de admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.241367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa949611-1ec7-4e7a-beeb-4b94e65d87de admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.241669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa949611-1ec7-4e7a-beeb-4b94e65d87de admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.242363 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa949611-1ec7-4e7a-beeb-4b94e65d87de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:33.244296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa949611-1ec7-4e7a-beeb-4b94e65d87de admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.272381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1298/2585] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:45:33 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:45:33.276967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:33.287534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b579-ed01-4122-9b8d-6358e6957473 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:33.346765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d69126-44e5-4c52-9163-d3fd3b14aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:33.347353 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69126-44e5-4c52-9163-d3fd3b14aabd admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.347680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69126-44e5-4c52-9163-d3fd3b14aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.347954 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69126-44e5-4c52-9163-d3fd3b14aabd admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.348640 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d69126-44e5-4c52-9163-d3fd3b14aabd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:33.350611 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d69126-44e5-4c52-9163-d3fd3b14aabd admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.373440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1288/2586] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:45:33 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:45:33.377621 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa949611-1ec7-4e7a-beeb-4b94e65d87de admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:33.387843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa949611-1ec7-4e7a-beeb-4b94e65d87de admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:33.392538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075677a-6168-479d-a189-326e09560c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:33.393211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075677a-6168-479d-a189-326e09560c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.393492 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075677a-6168-479d-a189-326e09560c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.393787 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075677a-6168-479d-a189-326e09560c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.394548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075677a-6168-479d-a189-326e09560c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:33.396214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075677a-6168-479d-a189-326e09560c47 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.406885 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1299/2587] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:45:33.410998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d69126-44e5-4c52-9163-d3fd3b14aabd admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:33.422671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d69126-44e5-4c52-9163-d3fd3b14aabd admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:33.427566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a604aa-98f8-49fb-8e75-02315572b32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:33.428236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a604aa-98f8-49fb-8e75-02315572b32d admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.428648 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a604aa-98f8-49fb-8e75-02315572b32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.429333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a604aa-98f8-49fb-8e75-02315572b32d admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.430780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a604aa-98f8-49fb-8e75-02315572b32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:33.432188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a604aa-98f8-49fb-8e75-02315572b32d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.443511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1289/2588] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:45:33.447706 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075677a-6168-479d-a189-326e09560c47 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:33.457894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075677a-6168-479d-a189-326e09560c47 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:33.462768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:33.463751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.464030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.464338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] PATH_INFO: `/v3/projects/8b218f6b53844d828be7b8c5de1cde67/users/e1ddee42951b4de98dea071f2b7a9958/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.479579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b218f6b53844d828be7b8c5de1cde67, user_id=e1ddee42951b4de98dea071f2b7a9958, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:33.482297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.496084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1300/2589] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:45:33 2022] PUT /identity/v3/projects/8b218f6b53844d828be7b8c5de1cde67/users/e1ddee42951b4de98dea071f2b7a9958/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:45:33.501331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0fbcc-b9ca-4dda-969d-844be382c5df None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.501652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0fbcc-b9ca-4dda-969d-844be382c5df None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.501936 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0fbcc-b9ca-4dda-969d-844be382c5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.520048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d0d0fbcc-b9ca-4dda-969d-844be382c5df None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:33.521273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d0d0fbcc-b9ca-4dda-969d-844be382c5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:33.581190 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1290/2590] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:45:33.590243 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:33.591390 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0fbcc-b9ca-4dda-969d-844be382c5df None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:33.592008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:33.592800 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d0d0fbcc-b9ca-4dda-969d-844be382c5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:33.659031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0fbcc-b9ca-4dda-969d-844be382c5df None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:33.662897 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561751e-4cc8-4e4f-9adc-23443cff45b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:33.663563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561751e-4cc8-4e4f-9adc-23443cff45b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.664045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561751e-4cc8-4e4f-9adc-23443cff45b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.664332 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561751e-4cc8-4e4f-9adc-23443cff45b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.667731 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a89704-04d7-41ec-a094-9dfeab60b8b4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:33.673211 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:33.673885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561751e-4cc8-4e4f-9adc-23443cff45b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:33.674026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:33.674179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:33.674460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:33.675361 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561751e-4cc8-4e4f-9adc-23443cff45b7 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.676367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:33.684692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1291/2591] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:45:33.688544 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:33.690183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:33.703659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1301/2592] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:37.737320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33391a27-e7d5-42a5-a839-cbcbd60d3da5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:37.738301 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33391a27-e7d5-42a5-a839-cbcbd60d3da5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:37.738835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33391a27-e7d5-42a5-a839-cbcbd60d3da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:37.769998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-33391a27-e7d5-42a5-a839-cbcbd60d3da5 None None] MFA Rules not processed for user `e1ddee42951b4de98dea071f2b7a9958`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:37.771745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-33391a27-e7d5-42a5-a839-cbcbd60d3da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:37.844898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1292/2593] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:45:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:45:37.859823 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:37.871543 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb5ee-36d9-4775-8d9e-94f8d849f830 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:37.877371 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c72d-db2d-4c03-b812-50179009f9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:37.878057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c72d-db2d-4c03-b812-50179009f9a7 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:37.878341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c72d-db2d-4c03-b812-50179009f9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:37.878702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c72d-db2d-4c03-b812-50179009f9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:37.887604 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c72d-db2d-4c03-b812-50179009f9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:37.889245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c72d-db2d-4c03-b812-50179009f9a7 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:37.912899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1302/2594] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:40.937539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b69a9-8faa-4e73-9c98-4c28e00ff49a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:40.938107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b69a9-8faa-4e73-9c98-4c28e00ff49a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:40.938512 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b69a9-8faa-4e73-9c98-4c28e00ff49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:40.997906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-469b69a9-8faa-4e73-9c98-4c28e00ff49a None None] MFA Rules not processed for user `e1ddee42951b4de98dea071f2b7a9958`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:40.999215 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-469b69a9-8faa-4e73-9c98-4c28e00ff49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:41.032265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1293/2595] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:45:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:45:41.456328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c72d-db2d-4c03-b812-50179009f9a7 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:41.468793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c72d-db2d-4c03-b812-50179009f9a7 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:41.474381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:41.475045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:41.475320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:41.475591 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:41.477531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:41.491281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:41.493183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:41.518632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1303/2596] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:45:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:45:47.179418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310867ca-af62-4fed-96e5-2104db4fb057 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:47.179992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310867ca-af62-4fed-96e5-2104db4fb057 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:47.179992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310867ca-af62-4fed-96e5-2104db4fb057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:47.198014 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-310867ca-af62-4fed-96e5-2104db4fb057 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:45:47.199357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-310867ca-af62-4fed-96e5-2104db4fb057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:47.254778 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1294/2597] 10.222.0.58 () {58 vars in 967 bytes} [Mon May 16 17:45:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:45:47.298951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:47.300610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:47.372816 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c824-5e0a-4a07-b7a3-7172c5b619d5 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:47.379288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a281d7-984e-4f83-8428-70b43804d690 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:47.379937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a281d7-984e-4f83-8428-70b43804d690 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:47.380217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a281d7-984e-4f83-8428-70b43804d690 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:47.380470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a281d7-984e-4f83-8428-70b43804d690 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:47.389388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a281d7-984e-4f83-8428-70b43804d690 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:47.391011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a281d7-984e-4f83-8428-70b43804d690 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:47.399379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1304/2598] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:45:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:45:54.321475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310867ca-af62-4fed-96e5-2104db4fb057 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:54.323306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-310867ca-af62-4fed-96e5-2104db4fb057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:54.339735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310867ca-af62-4fed-96e5-2104db4fb057 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:54.348138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:54.349168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:54.349445 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:54.349741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] PATH_INFO: `/v3/users/fea27ed178c8437697a23591a2163768` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:54.350948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea27ed178c8437697a23591a2163768)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:54.352893 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:54.400992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea27ed178c8437697a23591a2163768'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.412908 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea27ed178c8437697a23591a2163768'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.413839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea27ed178c8437697a23591a2163768'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.414534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea27ed178c8437697a23591a2163768'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.422239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea27ed178c8437697a23591a2163768'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.437021 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1295/2599] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:45:54 2022] DELETE /identity/v3/users/fea27ed178c8437697a23591a2163768 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:45:54.614280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a281d7-984e-4f83-8428-70b43804d690 service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:54.632450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a281d7-984e-4f83-8428-70b43804d690 service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:54.690582 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:54.691378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:54.691652 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:54.691924 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] PATH_INFO: `/v3/projects/2a1f3dc604cd46e4961489cd14f66d13` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:54.693215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1f3dc604cd46e4961489cd14f66d13)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:54.695436 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:54.742750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1f3dc604cd46e4961489cd14f66d13', 'request_id': 'req-d51f88da-baea-4317-9b29-b6796105d43b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.749323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1f3dc604cd46e4961489cd14f66d13', 'request_id': 'req-d51f88da-baea-4317-9b29-b6796105d43b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.758458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1f3dc604cd46e4961489cd14f66d13', 'request_id': 'req-d51f88da-baea-4317-9b29-b6796105d43b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.768835 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] The token cache is being invalidate because project 2a1f3dc604cd46e4961489cd14f66d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:45:54.769142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.769920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.771879 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1305/2600] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:45:54 2022] DELETE /identity/v3/projects/2a1f3dc604cd46e4961489cd14f66d13 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:45:54.775638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:54.777065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:54.789789 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657b023-0616-4868-9709-e59a8d6c713a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:54.846440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:54.847328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:54.847605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:54.847873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] PATH_INFO: `/v3/users/e662c8b021b64140a42ce000de0edea0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:54.849112 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] RBAC: Authorizing `identity:delete_user(user_id=e662c8b021b64140a42ce000de0edea0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:54.851069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:54.901921 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e662c8b021b64140a42ce000de0edea0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.915996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e662c8b021b64140a42ce000de0edea0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.916935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e662c8b021b64140a42ce000de0edea0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.917740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e662c8b021b64140a42ce000de0edea0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.925140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e662c8b021b64140a42ce000de0edea0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:54.948487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1296/2601] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:45:54 2022] DELETE /identity/v3/users/e662c8b021b64140a42ce000de0edea0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:45:55.136483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:45:55.138299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:45:55.153064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f88da-baea-4317-9b29-b6796105d43b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:45:55.215147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:45:55.216018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:45:55.216323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:45:55.216595 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] PATH_INFO: `/v3/projects/9794e667071c46f5a45dbfb038b52220` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:45:55.218140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9794e667071c46f5a45dbfb038b52220)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:45:55.220043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:45:55.265326 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9794e667071c46f5a45dbfb038b52220', 'request_id': 'req-f63abb0a-268e-4069-862f-5c266497a3b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:55.271499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9794e667071c46f5a45dbfb038b52220', 'request_id': 'req-f63abb0a-268e-4069-862f-5c266497a3b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:55.281871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9794e667071c46f5a45dbfb038b52220', 'request_id': 'req-f63abb0a-268e-4069-862f-5c266497a3b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:55.296179 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] The token cache is being invalidate because project 9794e667071c46f5a45dbfb038b52220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:45:55.296468 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:55.297198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:45:55.299017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1306/2602] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:45:55 2022] DELETE /identity/v3/projects/9794e667071c46f5a45dbfb038b52220 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:32.621739 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:32.623255 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:32.679442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e235-a7d8-485d-b5e7-8342049cacde admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:32.730253 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:32.730905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:32.731184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:32.731456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:32.733446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:32.798182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:32.799544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:32.809262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1297/2603] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:46:36.096826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:36.098376 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:36.111843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63abb0a-268e-4069-862f-5c266497a3b9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:36.117273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:36.118177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.118455 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.118728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] PATH_INFO: `/v3/users/6838738598ce4d2186e7c0b6547868f6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.119920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6838738598ce4d2186e7c0b6547868f6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:36.121867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:36.169370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6838738598ce4d2186e7c0b6547868f6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.182279 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6838738598ce4d2186e7c0b6547868f6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.182997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6838738598ce4d2186e7c0b6547868f6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.190150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6838738598ce4d2186e7c0b6547868f6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.199121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2288b356-1f2d-4524-b2e2-48e23a075a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6838738598ce4d2186e7c0b6547868f6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.205094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1307/2604] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:46:36 2022] DELETE /identity/v3/users/6838738598ce4d2186e7c0b6547868f6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:36.380138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:36.390380 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf516e6-e521-49bf-989e-80aa52f51adf service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:36.446451 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:36.447328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.447610 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.447887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] PATH_INFO: `/v3/projects/80c60c24806542e889c070d519172e79` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.449101 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c60c24806542e889c070d519172e79)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:36.451033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:36.500226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c60c24806542e889c070d519172e79', 'request_id': 'req-6fc51695-79e9-4bdd-8aa6-e91184e33aba'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.506212 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c60c24806542e889c070d519172e79', 'request_id': 'req-6fc51695-79e9-4bdd-8aa6-e91184e33aba'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.514536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c60c24806542e889c070d519172e79', 'request_id': 'req-6fc51695-79e9-4bdd-8aa6-e91184e33aba'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.525522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] The token cache is being invalidate because project 80c60c24806542e889c070d519172e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:46:36.525909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.526677 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fc51695-79e9-4bdd-8aa6-e91184e33aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:36.528394 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1298/2605] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:46:36 2022] DELETE /identity/v3/projects/80c60c24806542e889c070d519172e79 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:36.533650 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c068-c7f8-4615-aa7b-51b74624e79f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.533928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c068-c7f8-4615-aa7b-51b74624e79f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.534201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c068-c7f8-4615-aa7b-51b74624e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.552986 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-93e5c068-c7f8-4615-aa7b-51b74624e79f None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:36.554197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-93e5c068-c7f8-4615-aa7b-51b74624e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:36.614611 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1308/2606] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:36.626692 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b56244-7854-4e0c-bd37-bb34292e86ef None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.626915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b56244-7854-4e0c-bd37-bb34292e86ef None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.627188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b56244-7854-4e0c-bd37-bb34292e86ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.645906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b8b56244-7854-4e0c-bd37-bb34292e86ef None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:36.647099 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b8b56244-7854-4e0c-bd37-bb34292e86ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:36.655759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1299/2607] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:36.661202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c068-c7f8-4615-aa7b-51b74624e79f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:36.671651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c068-c7f8-4615-aa7b-51b74624e79f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:36.677283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:36.677972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.678245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.678543 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.679287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:46:36.679584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:36.681178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:36.692715 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1309/2608] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:46:36.697273 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b56244-7854-4e0c-bd37-bb34292e86ef None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:36.707665 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b56244-7854-4e0c-bd37-bb34292e86ef None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:36.713478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d3708-8ea3-4bea-9255-e94dbe189cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:36.714169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3708-8ea3-4bea-9255-e94dbe189cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.714447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3708-8ea3-4bea-9255-e94dbe189cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.714713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3708-8ea3-4bea-9255-e94dbe189cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.715409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d3708-8ea3-4bea-9255-e94dbe189cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:36.717309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d3708-8ea3-4bea-9255-e94dbe189cd3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:36.755697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1300/2609] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:46:36 2022] POST /identity/v3/projects => generated 409 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:46:36.760178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:36.770153 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea654b-6412-4467-8e5f-d7fadcc56eca admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:36.827212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e60697-5e88-4cee-b455-1be63837debf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:36.827874 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60697-5e88-4cee-b455-1be63837debf admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.828149 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60697-5e88-4cee-b455-1be63837debf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.828416 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60697-5e88-4cee-b455-1be63837debf admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.829090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e60697-5e88-4cee-b455-1be63837debf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:36.831103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e60697-5e88-4cee-b455-1be63837debf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:36.853103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1310/2610] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:46:36 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:46:36.858838 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d3708-8ea3-4bea-9255-e94dbe189cd3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:36.874333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d3708-8ea3-4bea-9255-e94dbe189cd3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:36.879949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f90455-4ac4-4cde-b1c8-31a85071422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:36.880549 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90455-4ac4-4cde-b1c8-31a85071422a admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.880832 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90455-4ac4-4cde-b1c8-31a85071422a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.881105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90455-4ac4-4cde-b1c8-31a85071422a admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.881879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90455-4ac4-4cde-b1c8-31a85071422a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:36.883513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90455-4ac4-4cde-b1c8-31a85071422a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:36.893525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1301/2611] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:46:36.897483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e60697-5e88-4cee-b455-1be63837debf admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:36.908164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e60697-5e88-4cee-b455-1be63837debf admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:36.913397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aad07-dd8b-408d-81b9-842c00b0b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:36.914082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aad07-dd8b-408d-81b9-842c00b0b751 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.914688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aad07-dd8b-408d-81b9-842c00b0b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.914951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aad07-dd8b-408d-81b9-842c00b0b751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.915673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231aad07-dd8b-408d-81b9-842c00b0b751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:36.917264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231aad07-dd8b-408d-81b9-842c00b0b751 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:36.927259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1311/2612] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:46:36.931180 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f90455-4ac4-4cde-b1c8-31a85071422a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:36.941155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f90455-4ac4-4cde-b1c8-31a85071422a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:36.945976 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7db62-8b2c-47fe-9ae2-599380478338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:36.946854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7db62-8b2c-47fe-9ae2-599380478338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.947133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7db62-8b2c-47fe-9ae2-599380478338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.947409 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7db62-8b2c-47fe-9ae2-599380478338 admin admin] PATH_INFO: `/v3/projects/978b0eeca726470d9339b3495d81a275/users/2bd6055399a643a4897a72105ad5f956/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:36.961842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7db62-8b2c-47fe-9ae2-599380478338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978b0eeca726470d9339b3495d81a275, user_id=2bd6055399a643a4897a72105ad5f956, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:36.964476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7db62-8b2c-47fe-9ae2-599380478338 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:36.979426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1302/2613] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:46:36 2022] PUT /identity/v3/projects/978b0eeca726470d9339b3495d81a275/users/2bd6055399a643a4897a72105ad5f956/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:46:36.989654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad2d0-763b-4995-82f2-ce39406af2e4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:36.989949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad2d0-763b-4995-82f2-ce39406af2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:36.990226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad2d0-763b-4995-82f2-ce39406af2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.018046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-798ad2d0-763b-4995-82f2-ce39406af2e4 None None] MFA Rules not processed for user `2bd6055399a643a4897a72105ad5f956`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:37.019273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-798ad2d0-763b-4995-82f2-ce39406af2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:37.085844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1312/2614] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:37.090522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7db62-8b2c-47fe-9ae2-599380478338 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:37.156244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7db62-8b2c-47fe-9ae2-599380478338 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:37.161577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38921f8-fde0-4c47-ba6b-bb6bac8eaba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:37.162240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38921f8-fde0-4c47-ba6b-bb6bac8eaba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.162522 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38921f8-fde0-4c47-ba6b-bb6bac8eaba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.162824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38921f8-fde0-4c47-ba6b-bb6bac8eaba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.163533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38921f8-fde0-4c47-ba6b-bb6bac8eaba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:37.165779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38921f8-fde0-4c47-ba6b-bb6bac8eaba4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:37.192256 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1303/2615] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:46:37 2022] POST /identity/v3/projects => generated 407 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:46:37.196926 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad2d0-763b-4995-82f2-ce39406af2e4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:37.207757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad2d0-763b-4995-82f2-ce39406af2e4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:37.266067 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c846a-5c7d-43f2-bfd3-e31b12225953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:37.266749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c846a-5c7d-43f2-bfd3-e31b12225953 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.267027 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c846a-5c7d-43f2-bfd3-e31b12225953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.267294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c846a-5c7d-43f2-bfd3-e31b12225953 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.267984 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c846a-5c7d-43f2-bfd3-e31b12225953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:37.269966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c846a-5c7d-43f2-bfd3-e31b12225953 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:37.291771 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1313/2616] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:46:37 2022] POST /identity/v3/users => generated 310 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:46:37.296081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38921f8-fde0-4c47-ba6b-bb6bac8eaba4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:37.306357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38921f8-fde0-4c47-ba6b-bb6bac8eaba4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:37.311776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f650-0ab1-4d09-9780-356d11d0b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:37.312499 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f650-0ab1-4d09-9780-356d11d0b774 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.312774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f650-0ab1-4d09-9780-356d11d0b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.313037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f650-0ab1-4d09-9780-356d11d0b774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.313788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13f650-0ab1-4d09-9780-356d11d0b774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:37.315366 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13f650-0ab1-4d09-9780-356d11d0b774 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:37.326516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1304/2617] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:46:37.332769 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c846a-5c7d-43f2-bfd3-e31b12225953 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:37.343942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c846a-5c7d-43f2-bfd3-e31b12225953 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:37.349509 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7bf4-cb48-48fa-ab5a-088aa811fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:37.350467 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7bf4-cb48-48fa-ab5a-088aa811fd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.350800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7bf4-cb48-48fa-ab5a-088aa811fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.350958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7bf4-cb48-48fa-ab5a-088aa811fd9e admin admin] PATH_INFO: `/v3/projects/4525d075821942a08a8a2f177215f725/users/e5a10670ffaa4dd199c7943d595428f7/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.367133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f7bf4-cb48-48fa-ab5a-088aa811fd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4525d075821942a08a8a2f177215f725, user_id=e5a10670ffaa4dd199c7943d595428f7, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:37.369860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f7bf4-cb48-48fa-ab5a-088aa811fd9e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:37.384912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1314/2618] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:46:37 2022] PUT /identity/v3/projects/4525d075821942a08a8a2f177215f725/users/e5a10670ffaa4dd199c7943d595428f7/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:37.388835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f650-0ab1-4d09-9780-356d11d0b774 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:37.399034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f650-0ab1-4d09-9780-356d11d0b774 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:37.456872 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f53673-03c6-4853-aa39-62f27130f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:37.457577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53673-03c6-4853-aa39-62f27130f370 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.457865 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53673-03c6-4853-aa39-62f27130f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.458140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53673-03c6-4853-aa39-62f27130f370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.458869 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f53673-03c6-4853-aa39-62f27130f370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:37.460475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f53673-03c6-4853-aa39-62f27130f370 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:37.470604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1305/2619] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:46:37.474760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7bf4-cb48-48fa-ab5a-088aa811fd9e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:37.484907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7bf4-cb48-48fa-ab5a-088aa811fd9e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:37.490134 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:37.491010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.491270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.491538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] PATH_INFO: `/v3/projects/4525d075821942a08a8a2f177215f725/users/e5a10670ffaa4dd199c7943d595428f7/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.493632 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4525d075821942a08a8a2f177215f725, user_id=e5a10670ffaa4dd199c7943d595428f7, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:37.496303 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:37.506997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1315/2620] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:46:37 2022] PUT /identity/v3/projects/4525d075821942a08a8a2f177215f725/users/e5a10670ffaa4dd199c7943d595428f7/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:37.518352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ae7e8-50d1-4021-9d70-e90de8e75e2b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.518678 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ae7e8-50d1-4021-9d70-e90de8e75e2b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.518983 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ae7e8-50d1-4021-9d70-e90de8e75e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.547284 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4a8ae7e8-50d1-4021-9d70-e90de8e75e2b None None] MFA Rules not processed for user `e5a10670ffaa4dd199c7943d595428f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:37.548767 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4a8ae7e8-50d1-4021-9d70-e90de8e75e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:37.619393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1306/2621] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:46:37.632379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:37.634182 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:37.695354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc54e-af18-4825-b7c1-8d9004824ce5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:37.699237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:37.699979 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.700283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.700592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.710540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:37.711982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:37.721290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1316/2622] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:37 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:46:37.892879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ae7e8-50d1-4021-9d70-e90de8e75e2b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:37.904823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ae7e8-50d1-4021-9d70-e90de8e75e2b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:37.910207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:37.910857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:37.911133 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:37.911401 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:37.979743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:37.981090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:37.990250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1307/2623] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:46:40.106805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:40.109641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:40.179427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aa515-b7a2-46df-8ec2-b448a5757cd9 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:40.184063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:40.184730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:40.185011 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:40.185281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:40.187517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:40.249155 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:40.250623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:40.259690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1317/2624] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:46:45.162636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:45.164801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:45.178487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8197f6-d303-46ec-adf6-fad58cba75e0 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:45.182466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23c0ac-8ad6-470e-b872-05da082652ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:45.183120 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23c0ac-8ad6-470e-b872-05da082652ed service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:45.183388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23c0ac-8ad6-470e-b872-05da082652ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:45.183658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23c0ac-8ad6-470e-b872-05da082652ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:45.185560 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-aa23c0ac-8ad6-470e-b872-05da082652ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:45.247374 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23c0ac-8ad6-470e-b872-05da082652ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:45.248819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23c0ac-8ad6-470e-b872-05da082652ed service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:45.259134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1308/2625] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:46:45.333577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:45.360264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163487e-6dab-44bc-9f68-56f790503ab8 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:45.365128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:45.366050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:45.366331 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:45.366605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] PATH_INFO: `/v3/users/2bd6055399a643a4897a72105ad5f956` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:45.367848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd6055399a643a4897a72105ad5f956)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:45.370125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:45.427531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd6055399a643a4897a72105ad5f956'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:45.440039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd6055399a643a4897a72105ad5f956'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:45.441217 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd6055399a643a4897a72105ad5f956'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:45.449308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd6055399a643a4897a72105ad5f956'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:45.458400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd6055399a643a4897a72105ad5f956'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:45.468490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1318/2626] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:46:45 2022] DELETE /identity/v3/users/2bd6055399a643a4897a72105ad5f956 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:45.470399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70825-3e9d-4678-b853-028ebb7b6f62 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:45.470685 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70825-3e9d-4678-b853-028ebb7b6f62 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:45.471167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70825-3e9d-4678-b853-028ebb7b6f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:45.489035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-12a70825-3e9d-4678-b853-028ebb7b6f62 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:45.490294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-12a70825-3e9d-4678-b853-028ebb7b6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:45.548463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1309/2627] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:45.564872 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:45.566394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:45.623628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67d6f0-4555-43f2-9dc7-0b37b9045e9d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:45.627594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d217390-86a2-489d-bf88-c2b29dd960f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:45.628275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217390-86a2-489d-bf88-c2b29dd960f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:45.628552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217390-86a2-489d-bf88-c2b29dd960f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:45.628817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217390-86a2-489d-bf88-c2b29dd960f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:45.638117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d217390-86a2-489d-bf88-c2b29dd960f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:45.639555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d217390-86a2-489d-bf88-c2b29dd960f3 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:45.648867 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1319/2628] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:46:46.048297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a70825-3e9d-4678-b853-028ebb7b6f62 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:46.049756 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-12a70825-3e9d-4678-b853-028ebb7b6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:46.063563 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a70825-3e9d-4678-b853-028ebb7b6f62 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:46.069852 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:46.070741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:46.072209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:46.072209 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] PATH_INFO: `/v3/projects/978b0eeca726470d9339b3495d81a275` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:46.072982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=978b0eeca726470d9339b3495d81a275)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:46.075241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:46.122207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978b0eeca726470d9339b3495d81a275', 'request_id': 'req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.128474 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978b0eeca726470d9339b3495d81a275', 'request_id': 'req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.138268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978b0eeca726470d9339b3495d81a275', 'request_id': 'req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.149428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] The token cache is being invalidate because project 978b0eeca726470d9339b3495d81a275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:46:46.149753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.150400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.151964 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1310/2629] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:46:46 2022] DELETE /identity/v3/projects/978b0eeca726470d9339b3495d81a275 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:46.156007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d217390-86a2-489d-bf88-c2b29dd960f3 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:46.166077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d217390-86a2-489d-bf88-c2b29dd960f3 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:46.240262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:46.241472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:46.241786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:46.242077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] PATH_INFO: `/v3/users/e5a10670ffaa4dd199c7943d595428f7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:46.243589 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a10670ffaa4dd199c7943d595428f7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:46.245625 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:46.304045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a10670ffaa4dd199c7943d595428f7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.317964 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a10670ffaa4dd199c7943d595428f7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.318726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a10670ffaa4dd199c7943d595428f7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.325803 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a10670ffaa4dd199c7943d595428f7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.336174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-11856b42-5fa2-4c62-9d84-b50b14066c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a10670ffaa4dd199c7943d595428f7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.346751 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1320/2630] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:46:46 2022] DELETE /identity/v3/users/e5a10670ffaa4dd199c7943d595428f7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:46.801743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:46.803769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:46.816924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce43cb-1958-4b7c-b8f5-6035a6f464dc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:46.883944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:46.885801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:46.886167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:46.886530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] PATH_INFO: `/v3/projects/4525d075821942a08a8a2f177215f725` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:46.887881 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4525d075821942a08a8a2f177215f725)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:46.890150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:46.941351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4525d075821942a08a8a2f177215f725', 'request_id': 'req-2d09093e-d46a-4279-b136-a27806304c8c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.948581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4525d075821942a08a8a2f177215f725', 'request_id': 'req-2d09093e-d46a-4279-b136-a27806304c8c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.958489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4525d075821942a08a8a2f177215f725', 'request_id': 'req-2d09093e-d46a-4279-b136-a27806304c8c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.972047 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] The token cache is being invalidate because project 4525d075821942a08a8a2f177215f725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:46:46.972384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.973063 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2d09093e-d46a-4279-b136-a27806304c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:46.975535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1311/2631] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:46:46 2022] DELETE /identity/v3/projects/4525d075821942a08a8a2f177215f725 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:46.980574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a4284-f65a-4126-a28d-e427ade58f57 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:46.981069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a4284-f65a-4126-a28d-e427ade58f57 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:46.981541 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a4284-f65a-4126-a28d-e427ade58f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:46.999223 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c41a4284-f65a-4126-a28d-e427ade58f57 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:47.000560 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c41a4284-f65a-4126-a28d-e427ade58f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:47.066508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1321/2632] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:47.074567 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ba1bc-2ae8-4c82-99ba-06956b104577 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.074952 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ba1bc-2ae8-4c82-99ba-06956b104577 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.075996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ba1bc-2ae8-4c82-99ba-06956b104577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.097278 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-811ba1bc-2ae8-4c82-99ba-06956b104577 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:47.099065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-811ba1bc-2ae8-4c82-99ba-06956b104577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:47.110391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1312/2633] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:47.112782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a4284-f65a-4126-a28d-e427ade58f57 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.123246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a4284-f65a-4126-a28d-e427ade58f57 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.129368 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.130103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.130387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.130661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.131409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:46:47.131717 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.134278 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.154047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1322/2634] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:46:47.155404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ba1bc-2ae8-4c82-99ba-06956b104577 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.166207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ba1bc-2ae8-4c82-99ba-06956b104577 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.171460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c570d5-fa25-45a8-9a2c-fb999e610a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.172208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c570d5-fa25-45a8-9a2c-fb999e610a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.172566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c570d5-fa25-45a8-9a2c-fb999e610a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.172915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c570d5-fa25-45a8-9a2c-fb999e610a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.173717 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c570d5-fa25-45a8-9a2c-fb999e610a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.175750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c570d5-fa25-45a8-9a2c-fb999e610a48 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.208437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1313/2635] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:46:47 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:46:47.212981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.224529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47c4d6-d694-461d-b6c2-e449796cf0ee admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.288311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b405d-97d2-46e4-a388-3c3fbe4c4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.289522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b405d-97d2-46e4-a388-3c3fbe4c4978 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.289890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b405d-97d2-46e4-a388-3c3fbe4c4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.290244 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b405d-97d2-46e4-a388-3c3fbe4c4978 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.291033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b405d-97d2-46e4-a388-3c3fbe4c4978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.293030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b405d-97d2-46e4-a388-3c3fbe4c4978 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.318004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1323/2636] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:46:47 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:46:47.321383 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c570d5-fa25-45a8-9a2c-fb999e610a48 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.332016 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c570d5-fa25-45a8-9a2c-fb999e610a48 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.337342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d92501-cb96-469b-91e6-7093933f2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.338179 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d92501-cb96-469b-91e6-7093933f2cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.338493 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d92501-cb96-469b-91e6-7093933f2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.338791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d92501-cb96-469b-91e6-7093933f2cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.340471 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d92501-cb96-469b-91e6-7093933f2cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.342149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d92501-cb96-469b-91e6-7093933f2cd0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.376988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b405d-97d2-46e4-a388-3c3fbe4c4978 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.379999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1314/2637] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:46:47.388605 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b405d-97d2-46e4-a388-3c3fbe4c4978 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.394084 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791a247-be64-4af3-a405-76e64c5926dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.395601 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a247-be64-4af3-a405-76e64c5926dd admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.396038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a247-be64-4af3-a405-76e64c5926dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.396475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a247-be64-4af3-a405-76e64c5926dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.397264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791a247-be64-4af3-a405-76e64c5926dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.399293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791a247-be64-4af3-a405-76e64c5926dd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.413091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1324/2638] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:46:47.417944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d92501-cb96-469b-91e6-7093933f2cd0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.429294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d92501-cb96-469b-91e6-7093933f2cd0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.434238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db4ba-dbd0-467f-b7f3-f7c1f9867909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.435175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db4ba-dbd0-467f-b7f3-f7c1f9867909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.435454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db4ba-dbd0-467f-b7f3-f7c1f9867909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.435725 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db4ba-dbd0-467f-b7f3-f7c1f9867909 admin admin] PATH_INFO: `/v3/projects/1e25b451f4ef445089c7b2f2c34cb2db/users/003e5bbf62f148a89bbe01c93e85452e/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.456144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db4ba-dbd0-467f-b7f3-f7c1f9867909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e25b451f4ef445089c7b2f2c34cb2db, user_id=003e5bbf62f148a89bbe01c93e85452e, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.458876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db4ba-dbd0-467f-b7f3-f7c1f9867909 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.476807 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1315/2639] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:46:47 2022] PUT /identity/v3/projects/1e25b451f4ef445089c7b2f2c34cb2db/users/003e5bbf62f148a89bbe01c93e85452e/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:46:47.487163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf652d-c0a6-48ac-8912-b1a7c1765768 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.487449 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf652d-c0a6-48ac-8912-b1a7c1765768 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.487718 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf652d-c0a6-48ac-8912-b1a7c1765768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.517019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-dbcf652d-c0a6-48ac-8912-b1a7c1765768 None None] MFA Rules not processed for user `003e5bbf62f148a89bbe01c93e85452e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:47.518329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-dbcf652d-c0a6-48ac-8912-b1a7c1765768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:47.583712 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1325/2640] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:47.588427 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db4ba-dbd0-467f-b7f3-f7c1f9867909 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.650963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db4ba-dbd0-467f-b7f3-f7c1f9867909 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.655868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73225d-9228-4b3e-9280-a3d48a27edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.656534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73225d-9228-4b3e-9280-a3d48a27edd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.656816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73225d-9228-4b3e-9280-a3d48a27edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.657092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73225d-9228-4b3e-9280-a3d48a27edd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.657818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73225d-9228-4b3e-9280-a3d48a27edd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.659726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73225d-9228-4b3e-9280-a3d48a27edd2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.688124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1316/2641] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:46:47 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:46:47.692336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf652d-c0a6-48ac-8912-b1a7c1765768 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.703873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf652d-c0a6-48ac-8912-b1a7c1765768 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.768873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a35f-fbf6-4ee8-8cd5-f64f7a6f4381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.769944 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a35f-fbf6-4ee8-8cd5-f64f7a6f4381 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.770298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a35f-fbf6-4ee8-8cd5-f64f7a6f4381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.770607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a35f-fbf6-4ee8-8cd5-f64f7a6f4381 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.771406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405a35f-fbf6-4ee8-8cd5-f64f7a6f4381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.773854 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405a35f-fbf6-4ee8-8cd5-f64f7a6f4381 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.795225 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1326/2642] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:46:47 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:46:47.799176 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73225d-9228-4b3e-9280-a3d48a27edd2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.810651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73225d-9228-4b3e-9280-a3d48a27edd2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.819848 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32a41-44eb-4405-9047-4e06740c5d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.820748 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32a41-44eb-4405-9047-4e06740c5d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.821023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32a41-44eb-4405-9047-4e06740c5d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.821292 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32a41-44eb-4405-9047-4e06740c5d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.822668 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb32a41-44eb-4405-9047-4e06740c5d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.825475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb32a41-44eb-4405-9047-4e06740c5d21 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.843257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1317/2643] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:46:47.844607 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a35f-fbf6-4ee8-8cd5-f64f7a6f4381 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.856250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a35f-fbf6-4ee8-8cd5-f64f7a6f4381 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:47.862033 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8ca05-fe85-4280-b825-8f0883a067a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:47.863587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8ca05-fe85-4280-b825-8f0883a067a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:47.864409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8ca05-fe85-4280-b825-8f0883a067a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:47.864409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8ca05-fe85-4280-b825-8f0883a067a7 admin admin] PATH_INFO: `/v3/projects/183b0256b0004d7ea0f35a02b411cf93/users/5d4fb6d49ac5458a8754c9a3f2a5de2a/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:47.913756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8ca05-fe85-4280-b825-8f0883a067a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183b0256b0004d7ea0f35a02b411cf93, user_id=5d4fb6d49ac5458a8754c9a3f2a5de2a, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:47.919708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8ca05-fe85-4280-b825-8f0883a067a7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:47.948259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1327/2644] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:46:47 2022] PUT /identity/v3/projects/183b0256b0004d7ea0f35a02b411cf93/users/5d4fb6d49ac5458a8754c9a3f2a5de2a/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:47.949711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32a41-44eb-4405-9047-4e06740c5d21 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:47.972225 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32a41-44eb-4405-9047-4e06740c5d21 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:48.051538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2db9d-7866-4e3c-957e-3b36f4a550b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:48.052318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2db9d-7866-4e3c-957e-3b36f4a550b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:48.052661 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2db9d-7866-4e3c-957e-3b36f4a550b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:48.053101 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2db9d-7866-4e3c-957e-3b36f4a550b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:48.054068 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2db9d-7866-4e3c-957e-3b36f4a550b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:48.055868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2db9d-7866-4e3c-957e-3b36f4a550b2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:48.068586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1318/2645] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:46:48.072748 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8ca05-fe85-4280-b825-8f0883a067a7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:48.082768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8ca05-fe85-4280-b825-8f0883a067a7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:48.087531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:48.088425 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:48.088736 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:48.089006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] PATH_INFO: `/v3/projects/183b0256b0004d7ea0f35a02b411cf93/users/5d4fb6d49ac5458a8754c9a3f2a5de2a/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:48.091178 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] RBAC: Authorizing `identity:create_grant(project_id=183b0256b0004d7ea0f35a02b411cf93, user_id=5d4fb6d49ac5458a8754c9a3f2a5de2a, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:48.093806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:48.104076 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1328/2646] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:46:48 2022] PUT /identity/v3/projects/183b0256b0004d7ea0f35a02b411cf93/users/5d4fb6d49ac5458a8754c9a3f2a5de2a/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:48.115480 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50f8c-cd18-4419-9648-f47d697b78e2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:48.115750 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50f8c-cd18-4419-9648-f47d697b78e2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:48.116022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50f8c-cd18-4419-9648-f47d697b78e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:48.143394 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9be50f8c-cd18-4419-9648-f47d697b78e2 None None] MFA Rules not processed for user `5d4fb6d49ac5458a8754c9a3f2a5de2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:48.144917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9be50f8c-cd18-4419-9648-f47d697b78e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:48.219534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1319/2647] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:48.231092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:48.232860 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:48.290641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756de94b-3401-447b-a5fd-16b06cac854f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:48.295168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbdc44-f84b-4bbe-aa00-92329a868c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:48.295933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbdc44-f84b-4bbe-aa00-92329a868c59 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:48.296104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbdc44-f84b-4bbe-aa00-92329a868c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:48.296410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbdc44-f84b-4bbe-aa00-92329a868c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:48.306249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbdc44-f84b-4bbe-aa00-92329a868c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:48.307742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbdc44-f84b-4bbe-aa00-92329a868c59 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:48.317232 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1329/2648] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:46:48.899562 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50f8c-cd18-4419-9648-f47d697b78e2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:48.967779 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50f8c-cd18-4419-9648-f47d697b78e2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:48.972500 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:48.973449 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:48.973924 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:48.974266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] PATH_INFO: `/v3/users/003e5bbf62f148a89bbe01c93e85452e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:48.975632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003e5bbf62f148a89bbe01c93e85452e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:48.977780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:49.024747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003e5bbf62f148a89bbe01c93e85452e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.035876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003e5bbf62f148a89bbe01c93e85452e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.036548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003e5bbf62f148a89bbe01c93e85452e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.037137 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003e5bbf62f148a89bbe01c93e85452e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.043925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003e5bbf62f148a89bbe01c93e85452e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.058219 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1320/2649] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:46:48 2022] DELETE /identity/v3/users/003e5bbf62f148a89bbe01c93e85452e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:49.062838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997cd2-4c0c-4d41-abbb-3e359c4190d2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:49.063353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997cd2-4c0c-4d41-abbb-3e359c4190d2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:49.063457 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997cd2-4c0c-4d41-abbb-3e359c4190d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:49.080644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f9997cd2-4c0c-4d41-abbb-3e359c4190d2 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:49.081904 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f9997cd2-4c0c-4d41-abbb-3e359c4190d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:49.141263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1330/2650] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:49.152683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:49.154321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:49.215425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d8acc-7619-4a1a-9d38-a841f0446476 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:49.219213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29a29-2ee3-4eed-9579-a630d6419208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:49.219870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29a29-2ee3-4eed-9579-a630d6419208 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:49.220155 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29a29-2ee3-4eed-9579-a630d6419208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:49.220422 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29a29-2ee3-4eed-9579-a630d6419208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:49.229689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf29a29-2ee3-4eed-9579-a630d6419208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:49.231117 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf29a29-2ee3-4eed-9579-a630d6419208 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:49.240566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1321/2651] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:46:49.554578 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997cd2-4c0c-4d41-abbb-3e359c4190d2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:49.557985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f9997cd2-4c0c-4d41-abbb-3e359c4190d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:49.579250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997cd2-4c0c-4d41-abbb-3e359c4190d2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:49.584282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:49.585277 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:49.585440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:49.585759 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] PATH_INFO: `/v3/projects/1e25b451f4ef445089c7b2f2c34cb2db` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:49.587000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e25b451f4ef445089c7b2f2c34cb2db)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:49.588949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:49.638228 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e25b451f4ef445089c7b2f2c34cb2db', 'request_id': 'req-60b455d3-54c0-40b1-abff-56f2ce815eb2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.644466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e25b451f4ef445089c7b2f2c34cb2db', 'request_id': 'req-60b455d3-54c0-40b1-abff-56f2ce815eb2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.653624 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e25b451f4ef445089c7b2f2c34cb2db', 'request_id': 'req-60b455d3-54c0-40b1-abff-56f2ce815eb2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.665028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] The token cache is being invalidate because project 1e25b451f4ef445089c7b2f2c34cb2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:46:49.665316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.666008 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.667762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1331/2652] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:46:49 2022] DELETE /identity/v3/projects/1e25b451f4ef445089c7b2f2c34cb2db => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:49.672360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29a29-2ee3-4eed-9579-a630d6419208 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:49.682947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29a29-2ee3-4eed-9579-a630d6419208 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:49.743526 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:49.744421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:49.744697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:49.744966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] PATH_INFO: `/v3/users/5d4fb6d49ac5458a8754c9a3f2a5de2a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:49.746381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4fb6d49ac5458a8754c9a3f2a5de2a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:49.748354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:49.799160 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4fb6d49ac5458a8754c9a3f2a5de2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.812902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4fb6d49ac5458a8754c9a3f2a5de2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.813695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4fb6d49ac5458a8754c9a3f2a5de2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.814303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4fb6d49ac5458a8754c9a3f2a5de2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.821943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-160ce0de-7028-4d37-b34f-599ea1cffcf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4fb6d49ac5458a8754c9a3f2a5de2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:49.836528 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1322/2653] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:46:49 2022] DELETE /identity/v3/users/5d4fb6d49ac5458a8754c9a3f2a5de2a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:50.407948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:50.410230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:50.434940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b455d3-54c0-40b1-abff-56f2ce815eb2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:50.511529 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:50.512552 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:50.513009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:50.513258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] PATH_INFO: `/v3/projects/183b0256b0004d7ea0f35a02b411cf93` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:50.515600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183b0256b0004d7ea0f35a02b411cf93)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:50.517504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:50.570689 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183b0256b0004d7ea0f35a02b411cf93', 'request_id': 'req-922f5799-a5a2-49f0-b550-58fa0996e820'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:50.577348 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183b0256b0004d7ea0f35a02b411cf93', 'request_id': 'req-922f5799-a5a2-49f0-b550-58fa0996e820'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:50.588332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183b0256b0004d7ea0f35a02b411cf93', 'request_id': 'req-922f5799-a5a2-49f0-b550-58fa0996e820'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:50.600581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] The token cache is being invalidate because project 183b0256b0004d7ea0f35a02b411cf93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:46:50.600912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:50.601673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-922f5799-a5a2-49f0-b550-58fa0996e820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:50.603481 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1332/2654] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:46:50 2022] DELETE /identity/v3/projects/183b0256b0004d7ea0f35a02b411cf93 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:50.609775 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc7981-ba46-4169-ab13-df27f1f99374 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:50.610316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc7981-ba46-4169-ab13-df27f1f99374 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:50.610316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc7981-ba46-4169-ab13-df27f1f99374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:50.630638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cbdc7981-ba46-4169-ab13-df27f1f99374 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:50.632107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cbdc7981-ba46-4169-ab13-df27f1f99374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:50.692453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1323/2655] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:50.700006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848269d-b55f-4aa7-926e-772874ae64aa None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:50.700624 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848269d-b55f-4aa7-926e-772874ae64aa None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:50.700946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848269d-b55f-4aa7-926e-772874ae64aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:50.723237 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8848269d-b55f-4aa7-926e-772874ae64aa None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:50.724563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8848269d-b55f-4aa7-926e-772874ae64aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:50.736164 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1333/2656] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:50.737699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc7981-ba46-4169-ab13-df27f1f99374 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:50.747713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc7981-ba46-4169-ab13-df27f1f99374 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:50.752267 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:50.752948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:50.753214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:50.753489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:50.754453 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:46:50.754582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:50.756214 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:50.769590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1324/2657] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:46:50.772707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848269d-b55f-4aa7-926e-772874ae64aa None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:50.783312 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848269d-b55f-4aa7-926e-772874ae64aa None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:50.788157 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f13c2f-7f49-45f9-94a5-2c53f91de3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:50.788814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f13c2f-7f49-45f9-94a5-2c53f91de3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:50.789466 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f13c2f-7f49-45f9-94a5-2c53f91de3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:50.789778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f13c2f-7f49-45f9-94a5-2c53f91de3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:50.790508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f13c2f-7f49-45f9-94a5-2c53f91de3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:50.792393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f13c2f-7f49-45f9-94a5-2c53f91de3f4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:50.831563 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1334/2658] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:46:50 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:46:50.832941 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:50.843485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64105293-724e-4791-8a8a-936d88630ee7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:50.899071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7746b-e77e-4c78-83c2-d12652e18be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:50.899666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7746b-e77e-4c78-83c2-d12652e18be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:50.899948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7746b-e77e-4c78-83c2-d12652e18be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:50.900222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7746b-e77e-4c78-83c2-d12652e18be0 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:50.900911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7746b-e77e-4c78-83c2-d12652e18be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:50.902907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7746b-e77e-4c78-83c2-d12652e18be0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:50.924150 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1325/2659] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:46:50 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:46:50.928354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f13c2f-7f49-45f9-94a5-2c53f91de3f4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:50.938734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f13c2f-7f49-45f9-94a5-2c53f91de3f4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:50.943428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07762ca-8c66-470d-915c-79ee4baf77c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:50.944197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07762ca-8c66-470d-915c-79ee4baf77c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:50.944540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07762ca-8c66-470d-915c-79ee4baf77c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:50.944881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07762ca-8c66-470d-915c-79ee4baf77c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:50.945707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07762ca-8c66-470d-915c-79ee4baf77c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:50.947383 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07762ca-8c66-470d-915c-79ee4baf77c2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:50.958205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1335/2660] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:46:50.962320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7746b-e77e-4c78-83c2-d12652e18be0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:50.972835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7746b-e77e-4c78-83c2-d12652e18be0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:50.977590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92c456-0ccf-464d-b0c4-d782e3f7c027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:50.978258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92c456-0ccf-464d-b0c4-d782e3f7c027 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:50.978539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92c456-0ccf-464d-b0c4-d782e3f7c027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:50.978811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92c456-0ccf-464d-b0c4-d782e3f7c027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:50.979541 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92c456-0ccf-464d-b0c4-d782e3f7c027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:50.981144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92c456-0ccf-464d-b0c4-d782e3f7c027 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:50.996177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1326/2661] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:46:50.997757 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07762ca-8c66-470d-915c-79ee4baf77c2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:51.008558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07762ca-8c66-470d-915c-79ee4baf77c2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:51.013815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:51.014780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:51.015079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:51.015440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] PATH_INFO: `/v3/projects/987e191531b44753b9e743fa9f68c98a/users/445ce3002095415e84938df5eae418b3/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:51.030750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=987e191531b44753b9e743fa9f68c98a, user_id=445ce3002095415e84938df5eae418b3, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:51.033399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:51.048221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1336/2662] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:46:50 2022] PUT /identity/v3/projects/987e191531b44753b9e743fa9f68c98a/users/445ce3002095415e84938df5eae418b3/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:51.058594 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7d6c-f338-4058-b1af-05c2591974cf None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:51.058907 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7d6c-f338-4058-b1af-05c2591974cf None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:51.059182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7d6c-f338-4058-b1af-05c2591974cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:51.087857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f93b7d6c-f338-4058-b1af-05c2591974cf None None] MFA Rules not processed for user `445ce3002095415e84938df5eae418b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:51.089048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f93b7d6c-f338-4058-b1af-05c2591974cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:51.166513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1327/2663] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:46:51.178613 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:51.180013 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:51.263315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334742a7-321a-4443-9893-e3d725b4fafb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:51.267857 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43278916b971416e80a79077cf0da75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:51.268610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:51.268943 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:51.269293 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:51.283651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:51.286815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:51.300600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1337/2664] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:46:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:46:51.353712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cb81-aa8f-4094-9ec1-d71d8c4cbc7f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:51.354000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cb81-aa8f-4094-9ec1-d71d8c4cbc7f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:51.354274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946cb81-aa8f-4094-9ec1-d71d8c4cbc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:51.377255 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a946cb81-aa8f-4094-9ec1-d71d8c4cbc7f None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:46:51.379000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a946cb81-aa8f-4094-9ec1-d71d8c4cbc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:51.462705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1328/2665] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:46:51.536441 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:51.538000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:51.665654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733fcee-6080-4898-a986-93b3f84a5693 service glance] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:51.672338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ec447-316b-42d9-8996-0bf3e803be08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:51.673009 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ec447-316b-42d9-8996-0bf3e803be08 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:51.674317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ec447-316b-42d9-8996-0bf3e803be08 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:51.674317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ec447-316b-42d9-8996-0bf3e803be08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:51.684722 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ec447-316b-42d9-8996-0bf3e803be08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:51.687651 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ec447-316b-42d9-8996-0bf3e803be08 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:51.697747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1338/2666] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:46:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:46:52.322624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946cb81-aa8f-4094-9ec1-d71d8c4cbc7f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:52.325302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a946cb81-aa8f-4094-9ec1-d71d8c4cbc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:52.465385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946cb81-aa8f-4094-9ec1-d71d8c4cbc7f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:52.474676 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:52.475851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:52.476290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:52.476834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] PATH_INFO: `/v3/users/1ae731332a684481bef208fe5bfc4866` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:52.478994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae731332a684481bef208fe5bfc4866)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:52.481304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:52.569686 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae731332a684481bef208fe5bfc4866'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:52.596914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae731332a684481bef208fe5bfc4866'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:52.598429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae731332a684481bef208fe5bfc4866'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:52.599271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae731332a684481bef208fe5bfc4866'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:52.607290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae731332a684481bef208fe5bfc4866'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:52.632835 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1329/2667] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:46:52 2022] DELETE /identity/v3/users/1ae731332a684481bef208fe5bfc4866 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:52.852493 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ec447-316b-42d9-8996-0bf3e803be08 service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:52.876082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ec447-316b-42d9-8996-0bf3e803be08 service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:52.979784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:52.980938 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:52.981497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:52.982015 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] PATH_INFO: `/v3/projects/7ee0e621e3c34c3bba8434228c575a84` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:52.983561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee0e621e3c34c3bba8434228c575a84)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:52.985532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:53.053251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee0e621e3c34c3bba8434228c575a84', 'request_id': 'req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.073691 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee0e621e3c34c3bba8434228c575a84', 'request_id': 'req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.095165 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee0e621e3c34c3bba8434228c575a84', 'request_id': 'req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.109677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] The token cache is being invalidate because project 7ee0e621e3c34c3bba8434228c575a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:46:53.109677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.110142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.111968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1339/2668] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:46:52 2022] DELETE /identity/v3/projects/7ee0e621e3c34c3bba8434228c575a84 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:53.116220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:53.117698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:53.136081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a991bb-bf6b-4c05-a3b4-7730b62780e0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:53.205433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:53.205433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:53.205433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:53.205433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] PATH_INFO: `/v3/users/a2030802aa894e66a31a7731b265f22a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:53.205938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2030802aa894e66a31a7731b265f22a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:53.206207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:53.258819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2030802aa894e66a31a7731b265f22a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.272420 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2030802aa894e66a31a7731b265f22a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.273294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2030802aa894e66a31a7731b265f22a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.274011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2030802aa894e66a31a7731b265f22a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.282456 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-514cf3be-3b1f-4296-a9aa-3c297bd882ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2030802aa894e66a31a7731b265f22a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.308645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1330/2669] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:46:53 2022] DELETE /identity/v3/users/a2030802aa894e66a31a7731b265f22a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:46:53.572056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:46:53.573773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:46:53.592141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886b7c6-974f-44d5-bf4a-0f80c7cfae94 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:46:53.693771 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:46:53.694940 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:46:53.695215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:46:53.695486 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] PATH_INFO: `/v3/projects/9b9982dbfd59465783f2847fbcb8d441` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:46:53.697106 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9982dbfd59465783f2847fbcb8d441)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:46:53.699648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:46:53.753142 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9982dbfd59465783f2847fbcb8d441', 'request_id': 'req-c30f14ef-5250-4119-bc69-42d20ac7c478'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.759711 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9982dbfd59465783f2847fbcb8d441', 'request_id': 'req-c30f14ef-5250-4119-bc69-42d20ac7c478'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.771236 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9982dbfd59465783f2847fbcb8d441', 'request_id': 'req-c30f14ef-5250-4119-bc69-42d20ac7c478'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.785221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] The token cache is being invalidate because project 9b9982dbfd59465783f2847fbcb8d441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:46:53.785592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.786171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c30f14ef-5250-4119-bc69-42d20ac7c478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:46:53.793589 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1340/2670] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:46:53 2022] DELETE /identity/v3/projects/9b9982dbfd59465783f2847fbcb8d441 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:05.669929 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7d439-cf0c-4b9f-b893-373272986870 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:05.670530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7d439-cf0c-4b9f-b893-373272986870 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:05.670530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7d439-cf0c-4b9f-b893-373272986870 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:05.671943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1331/2671] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:47:05.678184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88b8a-19cc-4519-b810-01f663829aa0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:05.678677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88b8a-19cc-4519-b810-01f663829aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:05.678910 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88b8a-19cc-4519-b810-01f663829aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:05.697811 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ee88b8a-19cc-4519-b810-01f663829aa0 None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:05.699039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ee88b8a-19cc-4519-b810-01f663829aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:05.767353 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1341/2672] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:47:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:47:05.780074 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7d439-cf0c-4b9f-b893-373272986870 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:05.782831 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-83b7d439-cf0c-4b9f-b893-373272986870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:05.846127 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7d439-cf0c-4b9f-b893-373272986870 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:05.850844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306179-fc82-4533-afb1-8dd213e8bc4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43278916b971416e80a79077cf0da75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:05.851503 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306179-fc82-4533-afb1-8dd213e8bc4b service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:05.851859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306179-fc82-4533-afb1-8dd213e8bc4b service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:05.852042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306179-fc82-4533-afb1-8dd213e8bc4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:05.866801 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306179-fc82-4533-afb1-8dd213e8bc4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:05.868867 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306179-fc82-4533-afb1-8dd213e8bc4b service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:05.879378 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1332/2673] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:05.947592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4a526-f293-4280-a5fe-e0a85759137b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:05.947884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4a526-f293-4280-a5fe-e0a85759137b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:05.948160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4a526-f293-4280-a5fe-e0a85759137b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:05.949572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1342/2674] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:47:05.954828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5cfa-9aea-41fe-b341-4a1ad96ca68e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:05.955075 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5cfa-9aea-41fe-b341-4a1ad96ca68e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:05.955389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5cfa-9aea-41fe-b341-4a1ad96ca68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:05.974915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-371f5cfa-9aea-41fe-b341-4a1ad96ca68e None None] MFA Rules not processed for user `2fddf039f65a4cff95c9c2041dd81ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:05.976129 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-371f5cfa-9aea-41fe-b341-4a1ad96ca68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:06.028948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1333/2675] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:47:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:06.041246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4a526-f293-4280-a5fe-e0a85759137b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:06.042998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-32f4a526-f293-4280-a5fe-e0a85759137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:06.056750 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4a526-f293-4280-a5fe-e0a85759137b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:06.060855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eeffa-f4a4-4f08-8b89-7d83fb77ee31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:06.061690 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eeffa-f4a4-4f08-8b89-7d83fb77ee31 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:06.061971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eeffa-f4a4-4f08-8b89-7d83fb77ee31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:06.062400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eeffa-f4a4-4f08-8b89-7d83fb77ee31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:06.071767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728eeffa-f4a4-4f08-8b89-7d83fb77ee31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:06.073343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728eeffa-f4a4-4f08-8b89-7d83fb77ee31 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:06.081325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1343/2676] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:06.167090 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af515a2-f9e2-4002-819d-956d45768981 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:06.167381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af515a2-f9e2-4002-819d-956d45768981 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:06.167712 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af515a2-f9e2-4002-819d-956d45768981 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:06.169146 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1334/2677] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:47:06.174779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfec5b-d812-40f9-a52d-87e9d527dd7d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:06.175097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfec5b-d812-40f9-a52d-87e9d527dd7d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:06.175406 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfec5b-d812-40f9-a52d-87e9d527dd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:06.196677 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b2dfec5b-d812-40f9-a52d-87e9d527dd7d None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:06.197951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b2dfec5b-d812-40f9-a52d-87e9d527dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:06.208506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1344/2678] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:47:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:06.219638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af515a2-f9e2-4002-819d-956d45768981 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:06.231579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af515a2-f9e2-4002-819d-956d45768981 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:06.235539 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a76ad-eff2-4ccd-bf22-fc1366617b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:06.236177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a76ad-eff2-4ccd-bf22-fc1366617b3f service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:06.236454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a76ad-eff2-4ccd-bf22-fc1366617b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:06.236727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a76ad-eff2-4ccd-bf22-fc1366617b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:06.247230 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a76ad-eff2-4ccd-bf22-fc1366617b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:06.248710 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a76ad-eff2-4ccd-bf22-fc1366617b3f service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:06.259575 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1335/2679] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:07.146740 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfec5b-d812-40f9-a52d-87e9d527dd7d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:07.150825 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b2dfec5b-d812-40f9-a52d-87e9d527dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:07.221719 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfec5b-d812-40f9-a52d-87e9d527dd7d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:07.226543 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:07.227359 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:07.227644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:07.227932 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] PATH_INFO: `/v3/users/445ce3002095415e84938df5eae418b3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:07.229372 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=445ce3002095415e84938df5eae418b3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:07.231147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:07.279047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445ce3002095415e84938df5eae418b3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.291193 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445ce3002095415e84938df5eae418b3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.292004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445ce3002095415e84938df5eae418b3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.299936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445ce3002095415e84938df5eae418b3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.308450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445ce3002095415e84938df5eae418b3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.314696 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1345/2680] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:47:07 2022] DELETE /identity/v3/users/445ce3002095415e84938df5eae418b3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:07.319300 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ecd3-f2fd-4f74-a2a8-4c75e5cfc641 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:07.319821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ecd3-f2fd-4f74-a2a8-4c75e5cfc641 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:07.319926 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ecd3-f2fd-4f74-a2a8-4c75e5cfc641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:07.339192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1909ecd3-f2fd-4f74-a2a8-4c75e5cfc641 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:07.340397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1909ecd3-f2fd-4f74-a2a8-4c75e5cfc641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:07.401115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1336/2681] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:07.411089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:07.412749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:07.471066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3363-e320-4fbb-aa4e-d2fa9cadfe6d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:07.475502 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7189-8742-40cb-918a-cf3993693117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:07.476143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7189-8742-40cb-918a-cf3993693117 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:07.476421 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7189-8742-40cb-918a-cf3993693117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:07.476762 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7189-8742-40cb-918a-cf3993693117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:07.486913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7189-8742-40cb-918a-cf3993693117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:07.488364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7189-8742-40cb-918a-cf3993693117 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:07.498103 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1346/2682] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:07.758730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909ecd3-f2fd-4f74-a2a8-4c75e5cfc641 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:07.760481 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1909ecd3-f2fd-4f74-a2a8-4c75e5cfc641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:07.773097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909ecd3-f2fd-4f74-a2a8-4c75e5cfc641 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:07.778684 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:07.779722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:07.779992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:07.780260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] PATH_INFO: `/v3/projects/987e191531b44753b9e743fa9f68c98a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:07.781696 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=987e191531b44753b9e743fa9f68c98a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:07.783627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:07.831589 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987e191531b44753b9e743fa9f68c98a', 'request_id': 'req-cbc1364c-2f46-45e0-a912-5aed9b926b7d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.837814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987e191531b44753b9e743fa9f68c98a', 'request_id': 'req-cbc1364c-2f46-45e0-a912-5aed9b926b7d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.846484 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987e191531b44753b9e743fa9f68c98a', 'request_id': 'req-cbc1364c-2f46-45e0-a912-5aed9b926b7d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.857107 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] The token cache is being invalidate because project 987e191531b44753b9e743fa9f68c98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:47:07.857276 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.857912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cbc1364c-2f46-45e0-a912-5aed9b926b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:07.859524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1337/2683] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:47:07 2022] DELETE /identity/v3/projects/987e191531b44753b9e743fa9f68c98a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:47:07.864598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf2ac1-6116-4166-9594-c3456d762306 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:07.864939 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf2ac1-6116-4166-9594-c3456d762306 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:07.865257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf2ac1-6116-4166-9594-c3456d762306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:07.883215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-54bf2ac1-6116-4166-9594-c3456d762306 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:07.884472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54bf2ac1-6116-4166-9594-c3456d762306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:07.945034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1347/2684] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:07.953159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7cd7a-f2c7-4b7d-a27c-254749cddf0a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:07.953609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7cd7a-f2c7-4b7d-a27c-254749cddf0a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:07.953734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7cd7a-f2c7-4b7d-a27c-254749cddf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:07.972862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-34d7cd7a-f2c7-4b7d-a27c-254749cddf0a None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:07.974115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-34d7cd7a-f2c7-4b7d-a27c-254749cddf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:07.982363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1338/2685] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:07.986923 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf2ac1-6116-4166-9594-c3456d762306 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:07.996470 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf2ac1-6116-4166-9594-c3456d762306 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:08.001503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:08.002125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.002401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.002653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.003378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:47:08.003682 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:08.005272 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:08.017993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1348/2686] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:47:08.022705 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7cd7a-f2c7-4b7d-a27c-254749cddf0a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:08.033389 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7cd7a-f2c7-4b7d-a27c-254749cddf0a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:08.040138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c847e82-a756-49b1-8718-5cfeecdea089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:08.040811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c847e82-a756-49b1-8718-5cfeecdea089 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.041093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c847e82-a756-49b1-8718-5cfeecdea089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.041362 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c847e82-a756-49b1-8718-5cfeecdea089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.042271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c847e82-a756-49b1-8718-5cfeecdea089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:08.044670 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c847e82-a756-49b1-8718-5cfeecdea089 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:08.081125 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1339/2687] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:47:08 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:47:08.085041 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:08.095206 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f587065-1f5d-4a66-8ed3-00f8ab20ff0c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:08.156528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea652864-e2ad-42d5-8744-547fdba40b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:08.157261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652864-e2ad-42d5-8744-547fdba40b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.157520 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652864-e2ad-42d5-8744-547fdba40b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.157826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652864-e2ad-42d5-8744-547fdba40b93 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.158536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea652864-e2ad-42d5-8744-547fdba40b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:08.160499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea652864-e2ad-42d5-8744-547fdba40b93 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:08.187513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1349/2688] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:47:08 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:47:08.188996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c847e82-a756-49b1-8718-5cfeecdea089 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:08.199549 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c847e82-a756-49b1-8718-5cfeecdea089 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:08.208289 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50683229-6329-45e1-a042-23b6633dc1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:08.208698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50683229-6329-45e1-a042-23b6633dc1af admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.208977 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50683229-6329-45e1-a042-23b6633dc1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.209254 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50683229-6329-45e1-a042-23b6633dc1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.210018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50683229-6329-45e1-a042-23b6633dc1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:08.211622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50683229-6329-45e1-a042-23b6633dc1af admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:08.222693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1340/2689] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:47:08.226608 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea652864-e2ad-42d5-8744-547fdba40b93 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:08.236561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea652864-e2ad-42d5-8744-547fdba40b93 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:08.241298 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd747430-09c9-49f7-8441-7d10cc0024db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:08.241914 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd747430-09c9-49f7-8441-7d10cc0024db admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.242214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd747430-09c9-49f7-8441-7d10cc0024db admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.242546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd747430-09c9-49f7-8441-7d10cc0024db admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.243329 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd747430-09c9-49f7-8441-7d10cc0024db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:08.244868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd747430-09c9-49f7-8441-7d10cc0024db admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:08.248055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1b1f-cbf1-4cbf-a4ce-5184960940e7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.248411 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1b1f-cbf1-4cbf-a4ce-5184960940e7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.248745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1b1f-cbf1-4cbf-a4ce-5184960940e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.255330 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1350/2690] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:47:08.259156 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd747430-09c9-49f7-8441-7d10cc0024db admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:08.268639 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e26b1b1f-cbf1-4cbf-a4ce-5184960940e7 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:08.268794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd747430-09c9-49f7-8441-7d10cc0024db admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:08.269866 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e26b1b1f-cbf1-4cbf-a4ce-5184960940e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:08.273962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da353f-6f10-4821-a5fa-f09c00607b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:08.274989 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da353f-6f10-4821-a5fa-f09c00607b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.275271 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da353f-6f10-4821-a5fa-f09c00607b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.275681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da353f-6f10-4821-a5fa-f09c00607b8a admin admin] PATH_INFO: `/v3/projects/6f0bf3d89fd74fcfb6de7fdffc657085/users/41bc3e42db264ec3a3c4250f2070848d/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.291783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da353f-6f10-4821-a5fa-f09c00607b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0bf3d89fd74fcfb6de7fdffc657085, user_id=41bc3e42db264ec3a3c4250f2070848d, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:08.294479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da353f-6f10-4821-a5fa-f09c00607b8a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:08.309133 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1351/2691] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:47:08 2022] PUT /identity/v3/projects/6f0bf3d89fd74fcfb6de7fdffc657085/users/41bc3e42db264ec3a3c4250f2070848d/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:47:08.319046 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df508-6c37-456e-898b-361e6b295e54 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.319334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df508-6c37-456e-898b-361e6b295e54 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.319590 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df508-6c37-456e-898b-361e6b295e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.327955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1341/2692] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:47:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:47:08.339833 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b1b1f-cbf1-4cbf-a4ce-5184960940e7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:08.341226 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e26b1b1f-cbf1-4cbf-a4ce-5184960940e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:08.345701 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2e8df508-6c37-456e-898b-361e6b295e54 None None] MFA Rules not processed for user `41bc3e42db264ec3a3c4250f2070848d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:08.346838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2e8df508-6c37-456e-898b-361e6b295e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:08.409219 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1352/2693] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:47:08.410213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b1b1f-cbf1-4cbf-a4ce-5184960940e7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:08.422773 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8df508-6c37-456e-898b-361e6b295e54 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:08.424195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2e8df508-6c37-456e-898b-361e6b295e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:08.469398 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50834530-4e77-4216-b3b4-91b4e3c08541 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:08.470084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834530-4e77-4216-b3b4-91b4e3c08541 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.470368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834530-4e77-4216-b3b4-91b4e3c08541 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.470642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834530-4e77-4216-b3b4-91b4e3c08541 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.479169 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8df508-6c37-456e-898b-361e6b295e54 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:08.482821 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f86e7-1db8-4641-bf2b-74daf21ef720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:08.483464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f86e7-1db8-4641-bf2b-74daf21ef720 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:08.483727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f86e7-1db8-4641-bf2b-74daf21ef720 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:08.484054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f86e7-1db8-4641-bf2b-74daf21ef720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:08.492302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f86e7-1db8-4641-bf2b-74daf21ef720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:08.493845 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f86e7-1db8-4641-bf2b-74daf21ef720 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:08.502439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1353/2694] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:08.524404 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50834530-4e77-4216-b3b4-91b4e3c08541 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:08.526050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50834530-4e77-4216-b3b4-91b4e3c08541 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:08.534154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1342/2695] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:47:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 17:47:11.196299 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f86e7-1db8-4641-bf2b-74daf21ef720 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:11.274123 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f86e7-1db8-4641-bf2b-74daf21ef720 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:11.279617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:11.280542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:11.280891 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:11.281168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] PATH_INFO: `/v3/users/41bc3e42db264ec3a3c4250f2070848d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:11.282424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bc3e42db264ec3a3c4250f2070848d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:11.284374 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:11.340990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bc3e42db264ec3a3c4250f2070848d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:11.354880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bc3e42db264ec3a3c4250f2070848d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:11.355618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bc3e42db264ec3a3c4250f2070848d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:11.362317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bc3e42db264ec3a3c4250f2070848d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:11.370657 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bc3e42db264ec3a3c4250f2070848d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:11.377930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1354/2696] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:47:11 2022] DELETE /identity/v3/users/41bc3e42db264ec3a3c4250f2070848d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:11.382459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477070-7d0b-419c-8c19-70a9494a20e0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:11.383025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477070-7d0b-419c-8c19-70a9494a20e0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:11.383025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477070-7d0b-419c-8c19-70a9494a20e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:11.402198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f2477070-7d0b-419c-8c19-70a9494a20e0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:11.403597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f2477070-7d0b-419c-8c19-70a9494a20e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:11.465790 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1343/2697] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:11.476920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:11.478727 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:11.539743 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a83891-c865-4e52-9fc7-2886d82b1387 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:11.543877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a864d-5b5f-419b-8f1a-ce790694badf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:11.544873 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a864d-5b5f-419b-8f1a-ce790694badf service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:11.545381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a864d-5b5f-419b-8f1a-ce790694badf service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:11.545906 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a864d-5b5f-419b-8f1a-ce790694badf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:11.557455 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a864d-5b5f-419b-8f1a-ce790694badf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:11.559104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a864d-5b5f-419b-8f1a-ce790694badf service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:11.569185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1355/2698] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:11.956337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2477070-7d0b-419c-8c19-70a9494a20e0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:11.957476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f2477070-7d0b-419c-8c19-70a9494a20e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:11.971714 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2477070-7d0b-419c-8c19-70a9494a20e0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:11.977524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:11.978436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:11.978719 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:11.978994 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] PATH_INFO: `/v3/projects/6f0bf3d89fd74fcfb6de7fdffc657085` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:11.980205 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0bf3d89fd74fcfb6de7fdffc657085)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:11.982272 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:12.035734 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0bf3d89fd74fcfb6de7fdffc657085', 'request_id': 'req-13407d8b-c228-4015-8dd8-730997b9d203'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:12.042108 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0bf3d89fd74fcfb6de7fdffc657085', 'request_id': 'req-13407d8b-c228-4015-8dd8-730997b9d203'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:12.050258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0bf3d89fd74fcfb6de7fdffc657085', 'request_id': 'req-13407d8b-c228-4015-8dd8-730997b9d203'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:12.061274 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] The token cache is being invalidate because project 6f0bf3d89fd74fcfb6de7fdffc657085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:47:12.061581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:12.062530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13407d8b-c228-4015-8dd8-730997b9d203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:12.064352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1344/2699] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:47:11 2022] DELETE /identity/v3/projects/6f0bf3d89fd74fcfb6de7fdffc657085 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:12.069302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568752-6a06-423d-a10b-fa7a856445ac None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.069598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568752-6a06-423d-a10b-fa7a856445ac None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.069881 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568752-6a06-423d-a10b-fa7a856445ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.090167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e3568752-6a06-423d-a10b-fa7a856445ac None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:12.091497 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e3568752-6a06-423d-a10b-fa7a856445ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:12.158140 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1356/2700] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:12.167682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec50cc-a2b3-4000-800d-e92a72c2647b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.167969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec50cc-a2b3-4000-800d-e92a72c2647b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.168247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec50cc-a2b3-4000-800d-e92a72c2647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.188222 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-39ec50cc-a2b3-4000-800d-e92a72c2647b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:12.190969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-39ec50cc-a2b3-4000-800d-e92a72c2647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:12.204984 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1345/2701] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:12.210551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568752-6a06-423d-a10b-fa7a856445ac None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:12.221102 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568752-6a06-423d-a10b-fa7a856445ac None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:12.226079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:12.226768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.227047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.227316 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.228040 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:47:12.228334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:12.230028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:12.247130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1357/2702] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:47:12.248330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec50cc-a2b3-4000-800d-e92a72c2647b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:12.258231 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec50cc-a2b3-4000-800d-e92a72c2647b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:12.263260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c22df-e65c-45a4-9608-a8b35c331811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:12.263950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c22df-e65c-45a4-9608-a8b35c331811 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.264217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c22df-e65c-45a4-9608-a8b35c331811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.264487 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c22df-e65c-45a4-9608-a8b35c331811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.265321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c22df-e65c-45a4-9608-a8b35c331811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:12.267468 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c22df-e65c-45a4-9608-a8b35c331811 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:12.303368 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1346/2703] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:47:12 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:47:12.307609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:12.318269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b5f03-5ce0-496d-b053-d208b44986c2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:12.376890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94422a-2bea-416c-85df-a189cc342ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:12.377795 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94422a-2bea-416c-85df-a189cc342ded admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.378078 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94422a-2bea-416c-85df-a189cc342ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.378354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94422a-2bea-416c-85df-a189cc342ded admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.379069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94422a-2bea-416c-85df-a189cc342ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:12.381055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94422a-2bea-416c-85df-a189cc342ded admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:12.401354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1358/2704] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:47:12 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:47:12.405580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c22df-e65c-45a4-9608-a8b35c331811 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:12.416463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c22df-e65c-45a4-9608-a8b35c331811 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:12.421476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803681f6-4a05-4dde-8c33-697b0b7d04bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:12.422221 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803681f6-4a05-4dde-8c33-697b0b7d04bb admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.422711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803681f6-4a05-4dde-8c33-697b0b7d04bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.422969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803681f6-4a05-4dde-8c33-697b0b7d04bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.424421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803681f6-4a05-4dde-8c33-697b0b7d04bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:12.426136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803681f6-4a05-4dde-8c33-697b0b7d04bb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:12.439115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1347/2705] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:47:12.443300 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94422a-2bea-416c-85df-a189cc342ded admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:12.454226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94422a-2bea-416c-85df-a189cc342ded admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:12.459791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234c25a-ee0a-42e5-8e40-f6e95e630831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:12.460571 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c25a-ee0a-42e5-8e40-f6e95e630831 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.460967 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c25a-ee0a-42e5-8e40-f6e95e630831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.461275 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234c25a-ee0a-42e5-8e40-f6e95e630831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.462150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234c25a-ee0a-42e5-8e40-f6e95e630831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:12.464017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234c25a-ee0a-42e5-8e40-f6e95e630831 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:12.478254 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1359/2706] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:47:12.479571 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803681f6-4a05-4dde-8c33-697b0b7d04bb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:12.491709 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803681f6-4a05-4dde-8c33-697b0b7d04bb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:12.497166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:12.498243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.498529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.498812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] PATH_INFO: `/v3/projects/5afd90e0135c4256bc5b4bccdc907700/users/80cfa49c432248a4b75f4f62e51e1715/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.513844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afd90e0135c4256bc5b4bccdc907700, user_id=80cfa49c432248a4b75f4f62e51e1715, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:12.516586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:12.530299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1348/2707] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:47:12 2022] PUT /identity/v3/projects/5afd90e0135c4256bc5b4bccdc907700/users/80cfa49c432248a4b75f4f62e51e1715/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:12.541838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc1ea-db90-44f1-a164-b29f5bec3a79 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.542135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc1ea-db90-44f1-a164-b29f5bec3a79 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.542409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bc1ea-db90-44f1-a164-b29f5bec3a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.579396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ff3bc1ea-db90-44f1-a164-b29f5bec3a79 None None] MFA Rules not processed for user `80cfa49c432248a4b75f4f62e51e1715`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:12.580542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ff3bc1ea-db90-44f1-a164-b29f5bec3a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:12.646788 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1360/2708] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:47:12.661018 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:12.662836 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:12.728916 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e4c55-92b2-4022-bce4-5756fe5276ce admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:12.732699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:12.733424 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:12.733834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:12.734298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:12.744629 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:12.746417 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:12.756178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1349/2709] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:30.107863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679882-a8b6-4b05-af74-7a7c8f417147 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:30.108488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679882-a8b6-4b05-af74-7a7c8f417147 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:30.108488 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679882-a8b6-4b05-af74-7a7c8f417147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:30.127350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fd679882-a8b6-4b05-af74-7a7c8f417147 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:30.128610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fd679882-a8b6-4b05-af74-7a7c8f417147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:30.182472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1361/2710] 10.222.0.58 () {58 vars in 967 bytes} [Mon May 16 17:47:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:30.195052 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:30.196627 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:30.267975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf416-e8b2-4ab1-9780-4a79d7718469 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:30.275207 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206db7b6-fd95-4701-befe-baac55db2ce5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:30.276105 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db7b6-fd95-4701-befe-baac55db2ce5 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:30.277288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db7b6-fd95-4701-befe-baac55db2ce5 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:30.277288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db7b6-fd95-4701-befe-baac55db2ce5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:30.290643 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206db7b6-fd95-4701-befe-baac55db2ce5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:30.292249 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206db7b6-fd95-4701-befe-baac55db2ce5 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:30.302601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1350/2711] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:47:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:47:47.022808 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd679882-a8b6-4b05-af74-7a7c8f417147 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:47.092160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd679882-a8b6-4b05-af74-7a7c8f417147 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:47.097148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:47.098058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:47.098296 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:47.098602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] PATH_INFO: `/v3/users/80cfa49c432248a4b75f4f62e51e1715` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:47.099871 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cfa49c432248a4b75f4f62e51e1715)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:47.101815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:47.154354 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cfa49c432248a4b75f4f62e51e1715'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.166713 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cfa49c432248a4b75f4f62e51e1715'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.167370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cfa49c432248a4b75f4f62e51e1715'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.173997 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cfa49c432248a4b75f4f62e51e1715'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.182409 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cfa49c432248a4b75f4f62e51e1715'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.188702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1362/2712] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:47:47 2022] DELETE /identity/v3/users/80cfa49c432248a4b75f4f62e51e1715 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:47.194172 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b5f79-c79b-49fb-a757-7e94fbe8f182 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:47.194727 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b5f79-c79b-49fb-a757-7e94fbe8f182 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:47.194850 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b5f79-c79b-49fb-a757-7e94fbe8f182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:47.213116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1b0b5f79-c79b-49fb-a757-7e94fbe8f182 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:47.214367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1b0b5f79-c79b-49fb-a757-7e94fbe8f182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:47.278363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1351/2713] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:47:47.293642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:47.295978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:47.368532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addceef6-c19b-42f7-aa21-3a916fc204f7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:47.373120 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fb631-fd59-4691-8feb-231d5b44d3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:47.373804 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fb631-fd59-4691-8feb-231d5b44d3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:47.374077 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fb631-fd59-4691-8feb-231d5b44d3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:47.374339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fb631-fd59-4691-8feb-231d5b44d3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:47.384948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fb631-fd59-4691-8feb-231d5b44d3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:47.386427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fb631-fd59-4691-8feb-231d5b44d3b4 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:47.396252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1363/2714] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:47.660185 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b5f79-c79b-49fb-a757-7e94fbe8f182 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:47.661842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1b0b5f79-c79b-49fb-a757-7e94fbe8f182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:47.674536 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b5f79-c79b-49fb-a757-7e94fbe8f182 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:47.679635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:47.680494 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:47.680769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:47.681035 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] PATH_INFO: `/v3/projects/5afd90e0135c4256bc5b4bccdc907700` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:47.682478 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afd90e0135c4256bc5b4bccdc907700)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:47.684262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:47.731780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afd90e0135c4256bc5b4bccdc907700', 'request_id': 'req-3b7180a5-3185-4536-8c0f-a16082ccf525'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.738028 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afd90e0135c4256bc5b4bccdc907700', 'request_id': 'req-3b7180a5-3185-4536-8c0f-a16082ccf525'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.746217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afd90e0135c4256bc5b4bccdc907700', 'request_id': 'req-3b7180a5-3185-4536-8c0f-a16082ccf525'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.756054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] The token cache is being invalidate because project 5afd90e0135c4256bc5b4bccdc907700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:47:47.756337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.756945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3b7180a5-3185-4536-8c0f-a16082ccf525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:47:47.758516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1352/2715] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:47:47 2022] DELETE /identity/v3/projects/5afd90e0135c4256bc5b4bccdc907700 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:47.763460 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5e49-61d5-4577-8989-b05e807c9f84 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:47.763741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5e49-61d5-4577-8989-b05e807c9f84 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:47.764014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5e49-61d5-4577-8989-b05e807c9f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:47.781930 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-db0f5e49-61d5-4577-8989-b05e807c9f84 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:47.783125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-db0f5e49-61d5-4577-8989-b05e807c9f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:47.846168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1364/2716] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:47.857887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0718a40-7147-4a49-ab4a-4b29e5e160be None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:47.858237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0718a40-7147-4a49-ab4a-4b29e5e160be None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:47.858578 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0718a40-7147-4a49-ab4a-4b29e5e160be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:47.882703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d0718a40-7147-4a49-ab4a-4b29e5e160be None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:47.883883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d0718a40-7147-4a49-ab4a-4b29e5e160be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:47.892400 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1353/2717] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:47.896555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5e49-61d5-4577-8989-b05e807c9f84 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:47.906592 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5e49-61d5-4577-8989-b05e807c9f84 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:47.912445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:47.913403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:47.913708 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:47.913976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:47.914653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:47:47.914985 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:47.916567 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:47.928264 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1365/2718] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:47:47.932732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0718a40-7147-4a49-ab4a-4b29e5e160be None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:47.942103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0718a40-7147-4a49-ab4a-4b29e5e160be None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:47.947134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c311d4-0e0f-442d-baa5-44052d9c64a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:47.947777 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c311d4-0e0f-442d-baa5-44052d9c64a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:47.948036 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c311d4-0e0f-442d-baa5-44052d9c64a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:47.948962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c311d4-0e0f-442d-baa5-44052d9c64a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:47.949728 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c311d4-0e0f-442d-baa5-44052d9c64a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:47.951622 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c311d4-0e0f-442d-baa5-44052d9c64a2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:47.978592 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1354/2719] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:47:47 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:47:47.985197 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:47.997200 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb569a-30e5-4a6c-9e8c-b6a576632497 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:48.059023 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543029f6-41c3-44f3-9e9e-34695de60af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:48.059709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543029f6-41c3-44f3-9e9e-34695de60af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:48.059892 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543029f6-41c3-44f3-9e9e-34695de60af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:48.060170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543029f6-41c3-44f3-9e9e-34695de60af9 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:48.060856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543029f6-41c3-44f3-9e9e-34695de60af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:48.062814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543029f6-41c3-44f3-9e9e-34695de60af9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:48.086343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1366/2720] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:47:47 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:47:48.090533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c311d4-0e0f-442d-baa5-44052d9c64a2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:48.101151 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c311d4-0e0f-442d-baa5-44052d9c64a2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:48.106064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092f37a-6abc-44df-9d34-3ba357989c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:48.106718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092f37a-6abc-44df-9d34-3ba357989c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:48.106999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092f37a-6abc-44df-9d34-3ba357989c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:48.107268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092f37a-6abc-44df-9d34-3ba357989c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:48.107993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092f37a-6abc-44df-9d34-3ba357989c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:48.109609 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092f37a-6abc-44df-9d34-3ba357989c81 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:48.119780 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1355/2721] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:47:48.123572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543029f6-41c3-44f3-9e9e-34695de60af9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:48.133459 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543029f6-41c3-44f3-9e9e-34695de60af9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:48.138335 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d116fc-2507-4460-8b26-ba3cfadf8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:48.138983 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d116fc-2507-4460-8b26-ba3cfadf8da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:48.139267 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d116fc-2507-4460-8b26-ba3cfadf8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:48.139540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d116fc-2507-4460-8b26-ba3cfadf8da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:48.140269 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d116fc-2507-4460-8b26-ba3cfadf8da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:48.142092 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d116fc-2507-4460-8b26-ba3cfadf8da2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:48.154045 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1367/2722] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:47:48.159323 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092f37a-6abc-44df-9d34-3ba357989c81 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:48.169830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092f37a-6abc-44df-9d34-3ba357989c81 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:48.175004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:48.175880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:48.176162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:48.176433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] PATH_INFO: `/v3/projects/782ab44dbedd4b94b6c8fb2414a51a79/users/bb1a88c50d7f46e297e683e6c7ef033e/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:48.193821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782ab44dbedd4b94b6c8fb2414a51a79, user_id=bb1a88c50d7f46e297e683e6c7ef033e, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:48.196466 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:48.211735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1356/2723] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:47:48 2022] PUT /identity/v3/projects/782ab44dbedd4b94b6c8fb2414a51a79/users/bb1a88c50d7f46e297e683e6c7ef033e/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:48.216791 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485c3d-fad5-4444-81ce-40898e40fc8d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:48.217079 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485c3d-fad5-4444-81ce-40898e40fc8d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:48.217351 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485c3d-fad5-4444-81ce-40898e40fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:48.233948 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-91485c3d-fad5-4444-81ce-40898e40fc8d None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:48.235126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-91485c3d-fad5-4444-81ce-40898e40fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:48.295096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1368/2724] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:48.304902 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:48.307050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:48.367153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff5d1-d4e9-48de-a8e3-8a7927157bc0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:48.371375 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20980fae-9960-48a4-b646-a7ce6c12bbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:48.372023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980fae-9960-48a4-b646-a7ce6c12bbea service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:48.372298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980fae-9960-48a4-b646-a7ce6c12bbea service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:48.372557 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980fae-9960-48a4-b646-a7ce6c12bbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:48.382967 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20980fae-9960-48a4-b646-a7ce6c12bbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:48.384391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20980fae-9960-48a4-b646-a7ce6c12bbea service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:48.394175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1357/2725] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:47:52.198855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5f8f-7385-48af-806c-13425b97cf38 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:52.199339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5f8f-7385-48af-806c-13425b97cf38 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:52.199536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5f8f-7385-48af-806c-13425b97cf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:52.237018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cc6b5f8f-7385-48af-806c-13425b97cf38 None None] MFA Rules not processed for user `bb1a88c50d7f46e297e683e6c7ef033e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:52.238226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cc6b5f8f-7385-48af-806c-13425b97cf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:52.305764 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1369/2726] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:47:52.310131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20980fae-9960-48a4-b646-a7ce6c12bbea service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:52.320007 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20980fae-9960-48a4-b646-a7ce6c12bbea service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:52.325069 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75395c51-22e6-41fa-aed7-b51271a1b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:52.325911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75395c51-22e6-41fa-aed7-b51271a1b829 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:52.326193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75395c51-22e6-41fa-aed7-b51271a1b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:52.326464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75395c51-22e6-41fa-aed7-b51271a1b829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:52.327164 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75395c51-22e6-41fa-aed7-b51271a1b829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:52.329114 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75395c51-22e6-41fa-aed7-b51271a1b829 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:52.355933 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1358/2727] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:47:52 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:47:52.359998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b5f8f-7385-48af-806c-13425b97cf38 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:52.370782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b5f8f-7385-48af-806c-13425b97cf38 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:52.439139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89da76d-5508-4988-bf89-2efca6390bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:52.439922 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89da76d-5508-4988-bf89-2efca6390bef admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:52.440198 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89da76d-5508-4988-bf89-2efca6390bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:52.440471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89da76d-5508-4988-bf89-2efca6390bef admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:52.441171 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89da76d-5508-4988-bf89-2efca6390bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:52.443256 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89da76d-5508-4988-bf89-2efca6390bef admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:52.464517 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1370/2728] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:47:52 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:47:52.468414 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75395c51-22e6-41fa-aed7-b51271a1b829 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:52.479139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75395c51-22e6-41fa-aed7-b51271a1b829 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:52.484620 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116fab8-6b01-4d1f-a2ff-670c8d69ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:52.485352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116fab8-6b01-4d1f-a2ff-670c8d69ce26 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:52.485680 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116fab8-6b01-4d1f-a2ff-670c8d69ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:52.485956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116fab8-6b01-4d1f-a2ff-670c8d69ce26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:52.486699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116fab8-6b01-4d1f-a2ff-670c8d69ce26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:52.488325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116fab8-6b01-4d1f-a2ff-670c8d69ce26 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:52.499880 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1359/2729] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:47:52.504337 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89da76d-5508-4988-bf89-2efca6390bef admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:52.514999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89da76d-5508-4988-bf89-2efca6390bef admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:52.519851 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6511b6-d3b4-40cc-b87e-68c988f38228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:52.520806 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6511b6-d3b4-40cc-b87e-68c988f38228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:52.521402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6511b6-d3b4-40cc-b87e-68c988f38228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:52.521402 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6511b6-d3b4-40cc-b87e-68c988f38228 admin admin] PATH_INFO: `/v3/projects/38b551e22edf4c559bb9d936361ed9e2/users/38123a952999418d8fba6f0c8e8ded6c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:52.537426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6511b6-d3b4-40cc-b87e-68c988f38228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b551e22edf4c559bb9d936361ed9e2, user_id=38123a952999418d8fba6f0c8e8ded6c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:52.540681 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6511b6-d3b4-40cc-b87e-68c988f38228 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:52.554813 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1371/2730] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:47:52 2022] PUT /identity/v3/projects/38b551e22edf4c559bb9d936361ed9e2/users/38123a952999418d8fba6f0c8e8ded6c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:47:52.558958 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116fab8-6b01-4d1f-a2ff-670c8d69ce26 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:52.569538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116fab8-6b01-4d1f-a2ff-670c8d69ce26 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:52.625716 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1facaa-b986-4337-8fdd-695c33cc5c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:52.626399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1facaa-b986-4337-8fdd-695c33cc5c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:52.626707 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1facaa-b986-4337-8fdd-695c33cc5c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:52.626982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1facaa-b986-4337-8fdd-695c33cc5c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:52.627711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1facaa-b986-4337-8fdd-695c33cc5c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:52.629321 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1facaa-b986-4337-8fdd-695c33cc5c91 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:52.640365 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1360/2731] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:47:52.644603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6511b6-d3b4-40cc-b87e-68c988f38228 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:52.655589 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6511b6-d3b4-40cc-b87e-68c988f38228 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:52.660401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:52.661321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:52.661626 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:52.661917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] PATH_INFO: `/v3/projects/38b551e22edf4c559bb9d936361ed9e2/users/38123a952999418d8fba6f0c8e8ded6c/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:52.664215 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b551e22edf4c559bb9d936361ed9e2, user_id=38123a952999418d8fba6f0c8e8ded6c, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:52.666952 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:52.678056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1372/2732] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:47:52 2022] PUT /identity/v3/projects/38b551e22edf4c559bb9d936361ed9e2/users/38123a952999418d8fba6f0c8e8ded6c/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:47:56.997345 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da855-db3c-4ebe-ba0d-1c01ac960b5c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:56.997917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da855-db3c-4ebe-ba0d-1c01ac960b5c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:56.998005 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da855-db3c-4ebe-ba0d-1c01ac960b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:57.027379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-005da855-db3c-4ebe-ba0d-1c01ac960b5c None None] MFA Rules not processed for user `38123a952999418d8fba6f0c8e8ded6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:47:57.028485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-005da855-db3c-4ebe-ba0d-1c01ac960b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:57.099152 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1361/2733] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:47:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:47:57.113175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:47:57.115444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:47:57.192030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc28371-5507-49b4-bbc3-c094fd0971f7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:47:57.197531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3578e-8ee7-45e9-8ac9-ead274a10663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:47:57.198213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3578e-8ee7-45e9-8ac9-ead274a10663 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:47:57.198568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3578e-8ee7-45e9-8ac9-ead274a10663 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:47:57.198975 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3578e-8ee7-45e9-8ac9-ead274a10663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:47:57.259413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3578e-8ee7-45e9-8ac9-ead274a10663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:47:57.261287 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3578e-8ee7-45e9-8ac9-ead274a10663 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:47:57.271356 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1373/2734] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:47:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:48:04.572553 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da855-db3c-4ebe-ba0d-1c01ac960b5c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:48:04.574170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-005da855-db3c-4ebe-ba0d-1c01ac960b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:48:04.647788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da855-db3c-4ebe-ba0d-1c01ac960b5c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:48:04.652890 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6efa96-c49a-47c1-ab06-ad3b926dc831 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02938c77178a4f14a33ff1298775687c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:48:04.653535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6efa96-c49a-47c1-ab06-ad3b926dc831 service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:48:04.653843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6efa96-c49a-47c1-ab06-ad3b926dc831 service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:48:04.654119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6efa96-c49a-47c1-ab06-ad3b926dc831 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:48:04.656033 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8a6efa96-c49a-47c1-ab06-ad3b926dc831 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:48:04.667582 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6efa96-c49a-47c1-ab06-ad3b926dc831 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:48:04.669177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6efa96-c49a-47c1-ab06-ad3b926dc831 service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:48:04.680356 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1362/2735] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:48:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:48:13.608273 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ef63-dff3-4169-a0a9-9aeb42fbd8be None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:48:13.608800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ef63-dff3-4169-a0a9-9aeb42fbd8be None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:48:13.608800 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ef63-dff3-4169-a0a9-9aeb42fbd8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:48:13.625957 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8888ef63-dff3-4169-a0a9-9aeb42fbd8be None None] MFA Rules not processed for user `bb1a88c50d7f46e297e683e6c7ef033e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:48:13.627203 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8888ef63-dff3-4169-a0a9-9aeb42fbd8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:48:13.634261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1374/2736] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:48:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:48:13.791122 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2001c0-08c4-4639-9ddc-903b6b972dd6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:48:13.791635 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2001c0-08c4-4639-9ddc-903b6b972dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:48:13.791766 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2001c0-08c4-4639-9ddc-903b6b972dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:48:13.812201 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5c2001c0-08c4-4639-9ddc-903b6b972dd6 None None] MFA Rules not processed for user `e1ddee42951b4de98dea071f2b7a9958`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:48:13.813577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5c2001c0-08c4-4639-9ddc-903b6b972dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:48:13.867581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1363/2737] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:48:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:48:34.815061 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888ef63-dff3-4169-a0a9-9aeb42fbd8be None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:48:34.872412 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888ef63-dff3-4169-a0a9-9aeb42fbd8be None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:48:34.876910 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:48:34.877572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:48:34.877868 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:48:34.878141 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:48:34.888257 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:48:34.890364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:48:34.900369 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1375/2738] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:48:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:49:23.521268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ba89-7798-479e-80b3-25981b942c97 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:23.522123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ba89-7798-479e-80b3-25981b942c97 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:23.522328 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ba89-7798-479e-80b3-25981b942c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:23.541982 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4d74ba89-7798-479e-80b3-25981b942c97 None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:49:23.543188 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4d74ba89-7798-479e-80b3-25981b942c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:49:23.600968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1364/2739] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:49:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:49:23.651960 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:49:23.653469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:49:23.725637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb6bf1-3bee-4f24-b61d-7080d4639f1a service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:49:23.730889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b68a7-3cfd-43ed-a6d9-5b384b7aa835 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:49:23.731551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b68a7-3cfd-43ed-a6d9-5b384b7aa835 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:23.731834 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b68a7-3cfd-43ed-a6d9-5b384b7aa835 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:23.732111 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b68a7-3cfd-43ed-a6d9-5b384b7aa835 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:23.740370 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b68a7-3cfd-43ed-a6d9-5b384b7aa835 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:49:23.741990 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b68a7-3cfd-43ed-a6d9-5b384b7aa835 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:49:23.750464 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1376/2740] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:49:36.836459 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca9ad-5d4d-44ef-a8b5-5cf475986df3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:36.836999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca9ad-5d4d-44ef-a8b5-5cf475986df3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:36.836999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca9ad-5d4d-44ef-a8b5-5cf475986df3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:36.838452 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1365/2741] 10.222.0.58 () {54 vars in 921 bytes} [Mon May 16 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 17:49:36.843574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64428-5911-48e0-8776-ebacd9bb7152 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:36.844055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64428-5911-48e0-8776-ebacd9bb7152 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:36.844346 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64428-5911-48e0-8776-ebacd9bb7152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:36.863445 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1eb64428-5911-48e0-8776-ebacd9bb7152 None None] MFA Rules not processed for user `a7263b80be2c437997b1a18002c9969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:49:36.864638 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1eb64428-5911-48e0-8776-ebacd9bb7152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:49:36.874276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1377/2742] 10.222.0.58 () {58 vars in 1018 bytes} [Mon May 16 17:49:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:49:36.887651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ca9ad-5d4d-44ef-a8b5-5cf475986df3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:49:36.889483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f80ca9ad-5d4d-44ef-a8b5-5cf475986df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:49:36.946811 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ca9ad-5d4d-44ef-a8b5-5cf475986df3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:49:36.950843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947c57-3538-473d-adbd-9c8268f15871 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43278916b971416e80a79077cf0da75d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:49:36.951490 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947c57-3538-473d-adbd-9c8268f15871 service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:36.951772 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947c57-3538-473d-adbd-9c8268f15871 service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:36.952045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947c57-3538-473d-adbd-9c8268f15871 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:36.962590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947c57-3538-473d-adbd-9c8268f15871 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:49:36.964025 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947c57-3538-473d-adbd-9c8268f15871 service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:49:36.977844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1366/2743] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:49:38.765838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5593f8-2280-4813-be0c-2962bd7eb73d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:38.766375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5593f8-2280-4813-be0c-2962bd7eb73d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:38.766375 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5593f8-2280-4813-be0c-2962bd7eb73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:38.786177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1f5593f8-2280-4813-be0c-2962bd7eb73d None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:49:38.787342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f5593f8-2280-4813-be0c-2962bd7eb73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:49:38.796673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1378/2744] 10.222.0.58 () {58 vars in 1009 bytes} [Mon May 16 17:49:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:49:38.810525 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947c57-3538-473d-adbd-9c8268f15871 service glance] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:49:38.823416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947c57-3538-473d-adbd-9c8268f15871 service glance] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:49:38.829957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d699-013c-4d95-8f33-74fcb9a49dde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:49:38.830606 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d699-013c-4d95-8f33-74fcb9a49dde service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:38.830885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d699-013c-4d95-8f33-74fcb9a49dde service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:38.831153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d699-013c-4d95-8f33-74fcb9a49dde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:38.844239 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59d699-013c-4d95-8f33-74fcb9a49dde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:49:38.846169 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59d699-013c-4d95-8f33-74fcb9a49dde service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:49:38.854290 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1367/2745] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:49:54.123137 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f56c-251a-4213-ab18-018b20503eeb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:54.123730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f56c-251a-4213-ab18-018b20503eeb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:54.123730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f56c-251a-4213-ab18-018b20503eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:54.143006 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-eea7f56c-251a-4213-ab18-018b20503eeb None None] MFA Rules not processed for user `8a71982b29f447899a3d06885cf237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:49:54.144401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eea7f56c-251a-4213-ab18-018b20503eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:49:54.152953 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1379/2746] 10.222.0.58 () {58 vars in 967 bytes} [Mon May 16 17:49:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:49:54.166084 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d699-013c-4d95-8f33-74fcb9a49dde service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:49:54.176940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d699-013c-4d95-8f33-74fcb9a49dde service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:49:54.182597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e1b9-0cf6-4347-8d8f-fb7a164979c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f320795fd0b42319df94dbc171938b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:49:54.183263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e1b9-0cf6-4347-8d8f-fb7a164979c5 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:54.183547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e1b9-0cf6-4347-8d8f-fb7a164979c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:54.183820 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e1b9-0cf6-4347-8d8f-fb7a164979c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:54.191990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e1b9-0cf6-4347-8d8f-fb7a164979c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:49:54.193590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e1b9-0cf6-4347-8d8f-fb7a164979c5 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:49:54.201735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1368/2747] 10.222.0.58 () {60 vars in 1384 bytes} [Mon May 16 17:49:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:49:54.873170 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7f56c-251a-4213-ab18-018b20503eeb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:49:54.883753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7f56c-251a-4213-ab18-018b20503eeb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:49:54.888162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:49:54.888852 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:49:54.889128 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:49:54.889400 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:49:54.892579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:49:54.907130 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:49:54.908661 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:49:54.919865 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1380/2748] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:49:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:50:28.336071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e1b9-0cf6-4347-8d8f-fb7a164979c5 service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:28.346077 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e1b9-0cf6-4347-8d8f-fb7a164979c5 service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:28.351224 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:28.352039 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:28.352325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:28.352600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:28.354874 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:28.369442 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:28.370909 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:28.382307 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1369/2749] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:50:30.475095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:30.487899 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ccfc7-47b9-4016-8e36-74e7cb5c95fc service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:30.495339 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa29c82-f384-41b8-84aa-30959bb471b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:30.495999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29c82-f384-41b8-84aa-30959bb471b9 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:30.496289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29c82-f384-41b8-84aa-30959bb471b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:30.496561 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29c82-f384-41b8-84aa-30959bb471b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:30.498490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-dfa29c82-f384-41b8-84aa-30959bb471b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:30.515527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa29c82-f384-41b8-84aa-30959bb471b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:30.517388 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa29c82-f384-41b8-84aa-30959bb471b9 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:30.529283 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1381/2750] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:50:35.024587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:35.033441 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10e6b9-0a8e-4064-a6e5-b31d9a6ab46a service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:35.037884 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:35.038516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:35.039088 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:35.039363 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:35.041311 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:35.105846 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:35.107436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:35.118057 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1370/2751] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:50:39.052919 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f08a-b3fb-4295-9edd-cf1889e8af46 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.053440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f08a-b3fb-4295-9edd-cf1889e8af46 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.053440 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f08a-b3fb-4295-9edd-cf1889e8af46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.078884 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-af96f08a-b3fb-4295-9edd-cf1889e8af46 None None] MFA Rules not processed for user `bb1a88c50d7f46e297e683e6c7ef033e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:50:39.080251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af96f08a-b3fb-4295-9edd-cf1889e8af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:39.089364 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1382/2752] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:50:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:50:39.094889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.096529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:39.111119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6498c3-1c87-46f9-88d4-364c7df71514 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.117412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.118386 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.118857 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.119280 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] PATH_INFO: `/v3/users/e1ddee42951b4de98dea071f2b7a9958` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.120938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ddee42951b4de98dea071f2b7a9958)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.122899 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:39.178428 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ddee42951b4de98dea071f2b7a9958'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.190444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ddee42951b4de98dea071f2b7a9958'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.191138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ddee42951b4de98dea071f2b7a9958'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.191774 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ddee42951b4de98dea071f2b7a9958'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.198537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ddee42951b4de98dea071f2b7a9958'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.215079 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1371/2753] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:50:39 2022] DELETE /identity/v3/users/e1ddee42951b4de98dea071f2b7a9958 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:50:39.395724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f08a-b3fb-4295-9edd-cf1889e8af46 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.413250 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f08a-b3fb-4295-9edd-cf1889e8af46 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.426170 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.427732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:39.478407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.479362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.479707 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.479982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] PATH_INFO: `/v3/projects/8b218f6b53844d828be7b8c5de1cde67` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.481180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b218f6b53844d828be7b8c5de1cde67)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.483209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:39.483510 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8e5c1-8119-4180-a1b9-4ba1a2523a5e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.487080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aeac7-1545-4d2e-b0dc-c73d239e4d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.487742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aeac7-1545-4d2e-b0dc-c73d239e4d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.488029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aeac7-1545-4d2e-b0dc-c73d239e4d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.488298 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aeac7-1545-4d2e-b0dc-c73d239e4d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.490182 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6d5aeac7-1545-4d2e-b0dc-c73d239e4d0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:39.499818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aeac7-1545-4d2e-b0dc-c73d239e4d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.501243 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aeac7-1545-4d2e-b0dc-c73d239e4d0a service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:39.509387 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1372/2754] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:50:39.527723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b218f6b53844d828be7b8c5de1cde67', 'request_id': 'req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.533942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b218f6b53844d828be7b8c5de1cde67', 'request_id': 'req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.542119 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b218f6b53844d828be7b8c5de1cde67', 'request_id': 'req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.552060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] The token cache is being invalidate because project 8b218f6b53844d828be7b8c5de1cde67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:50:39.552344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.552961 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a6cc9554-f1c7-48da-aa8b-5adc9f174bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:50:39.554587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1383/2755] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:50:39 2022] DELETE /identity/v3/projects/8b218f6b53844d828be7b8c5de1cde67 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:50:39.559613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f8ee-0ec5-46a9-a512-50ab8ef5a829 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.559957 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f8ee-0ec5-46a9-a512-50ab8ef5a829 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.560306 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f8ee-0ec5-46a9-a512-50ab8ef5a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.577666 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b896f8ee-0ec5-46a9-a512-50ab8ef5a829 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:50:39.578769 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b896f8ee-0ec5-46a9-a512-50ab8ef5a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:39.650370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1373/2756] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:50:39.652856 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cef7c-7538-4c90-ac18-ae923e6d5838 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.653135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cef7c-7538-4c90-ac18-ae923e6d5838 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.653427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cef7c-7538-4c90-ac18-ae923e6d5838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.672317 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c50cef7c-7538-4c90-ac18-ae923e6d5838 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:50:39.673522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c50cef7c-7538-4c90-ac18-ae923e6d5838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:39.681752 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1384/2757] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:50:39.686745 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f8ee-0ec5-46a9-a512-50ab8ef5a829 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.699771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f8ee-0ec5-46a9-a512-50ab8ef5a829 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.705671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.707382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.708097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.708097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.708950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:50:39.709320 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.711139 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:39.724654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1374/2758] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:50:39.729252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cef7c-7538-4c90-ac18-ae923e6d5838 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.739478 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cef7c-7538-4c90-ac18-ae923e6d5838 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.744596 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c966739-aefc-40b6-81d7-7b22d6251ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.745323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966739-aefc-40b6-81d7-7b22d6251ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.745848 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966739-aefc-40b6-81d7-7b22d6251ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.746192 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966739-aefc-40b6-81d7-7b22d6251ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.747000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c966739-aefc-40b6-81d7-7b22d6251ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.749177 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c966739-aefc-40b6-81d7-7b22d6251ef7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:39.775581 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1385/2759] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:50:39 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:50:39.779519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.789938 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bbfa2-66d3-4379-b9b8-301fb1cd7a24 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.847673 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478da0-1922-400f-98f4-000dc8f75ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.848351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478da0-1922-400f-98f4-000dc8f75ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.848634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478da0-1922-400f-98f4-000dc8f75ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.848906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478da0-1922-400f-98f4-000dc8f75ccd admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.849630 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478da0-1922-400f-98f4-000dc8f75ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.851645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478da0-1922-400f-98f4-000dc8f75ccd admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:39.872154 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1375/2760] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:50:39 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:50:39.876828 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c966739-aefc-40b6-81d7-7b22d6251ef7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.887344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c966739-aefc-40b6-81d7-7b22d6251ef7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.892945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a806e-14a1-498c-9498-82bbd450e4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.893734 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a806e-14a1-498c-9498-82bbd450e4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.894014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a806e-14a1-498c-9498-82bbd450e4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.894325 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a806e-14a1-498c-9498-82bbd450e4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.895126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a806e-14a1-498c-9498-82bbd450e4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.896782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a806e-14a1-498c-9498-82bbd450e4ca admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:39.910660 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1386/2761] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:50:39.911960 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478da0-1922-400f-98f4-000dc8f75ccd admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.923031 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478da0-1922-400f-98f4-000dc8f75ccd admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.928416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.929149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.929469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.929810 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.930615 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.932257 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:39.947392 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1376/2762] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:50:39.949004 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a806e-14a1-498c-9498-82bbd450e4ca admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.960038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a806e-14a1-498c-9498-82bbd450e4ca admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:39.964949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b9995-4467-472a-8e28-30dd05f6bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:39.965864 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b9995-4467-472a-8e28-30dd05f6bd1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:39.966144 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b9995-4467-472a-8e28-30dd05f6bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:39.966413 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b9995-4467-472a-8e28-30dd05f6bd1a admin admin] PATH_INFO: `/v3/projects/2f074c24f4594fa89de6dfe2e38659c3/users/7ca3187ddb684fd1b90463f4adf4282d/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:39.983220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:39.984981 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:39.985201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b9995-4467-472a-8e28-30dd05f6bd1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f074c24f4594fa89de6dfe2e38659c3, user_id=7ca3187ddb684fd1b90463f4adf4282d, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:39.988088 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b9995-4467-472a-8e28-30dd05f6bd1a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:40.002174 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1387/2763] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:50:39 2022] PUT /identity/v3/projects/2f074c24f4594fa89de6dfe2e38659c3/users/7ca3187ddb684fd1b90463f4adf4282d/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:50:40.007863 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676de71-5ee3-4ceb-820a-a9eb9311cb88 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:40.008151 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676de71-5ee3-4ceb-820a-a9eb9311cb88 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:40.008424 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676de71-5ee3-4ceb-820a-a9eb9311cb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:40.032053 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d676de71-5ee3-4ceb-820a-a9eb9311cb88 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:50:40.033323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d676de71-5ee3-4ceb-820a-a9eb9311cb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:40.065538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5dda2-c894-4a65-91eb-f6bd1f4c1775 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:40.100378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1388/2764] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:50:40.110115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676de71-5ee3-4ceb-820a-a9eb9311cb88 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:40.111472 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d676de71-5ee3-4ceb-820a-a9eb9311cb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:40.124834 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02938c77178a4f14a33ff1298775687c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:40.125488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:40.125791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:40.126062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:40.127873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:40.138784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:40.140355 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:40.150501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1377/2765] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:50:40.166109 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676de71-5ee3-4ceb-820a-a9eb9311cb88 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:40.169747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c917a73-a71b-40bf-8bca-cec33d47a773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:40.170398 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917a73-a71b-40bf-8bca-cec33d47a773 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:40.170678 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917a73-a71b-40bf-8bca-cec33d47a773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:40.170950 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917a73-a71b-40bf-8bca-cec33d47a773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:40.179805 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c917a73-a71b-40bf-8bca-cec33d47a773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:40.181233 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c917a73-a71b-40bf-8bca-cec33d47a773 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:40.190698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1389/2766] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:50:41.928999 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:41.930690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:41.945464 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54af3-2e19-40bc-82aa-26c1908e11df service placement] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:41.949163 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:41.949853 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:41.950304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:41.950759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:41.952947 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:41.963342 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:41.965102 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:41.975988 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1378/2767] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:50:44.705960 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcf555-0008-4768-a548-d4b1ecc03ed6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:44.706526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcf555-0008-4768-a548-d4b1ecc03ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:44.706526 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcf555-0008-4768-a548-d4b1ecc03ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:44.740962 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c0fcf555-0008-4768-a548-d4b1ecc03ed6 None None] MFA Rules not processed for user `7ca3187ddb684fd1b90463f4adf4282d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:50:44.742362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c0fcf555-0008-4768-a548-d4b1ecc03ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:44.813360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1390/2768] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:50:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:50:44.828056 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:44.829612 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:44.912251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dd691-49a5-44ab-a4fb-808edc6067df service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:44.918381 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3b10-ebdc-477d-acc9-833020ddeb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:44.919121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3b10-ebdc-477d-acc9-833020ddeb7c service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:44.919546 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3b10-ebdc-477d-acc9-833020ddeb7c service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:44.920034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3b10-ebdc-477d-acc9-833020ddeb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:44.928906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3b10-ebdc-477d-acc9-833020ddeb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:44.930544 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3b10-ebdc-477d-acc9-833020ddeb7c service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:44.940488 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1379/2769] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:50:46.342572 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd1af-5730-44a6-80a8-5a24efdea099 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:46.343213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd1af-5730-44a6-80a8-5a24efdea099 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:46.343213 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd1af-5730-44a6-80a8-5a24efdea099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:46.361959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ec1cd1af-5730-44a6-80a8-5a24efdea099 None None] MFA Rules not processed for user `7ca3187ddb684fd1b90463f4adf4282d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:50:46.363245 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ec1cd1af-5730-44a6-80a8-5a24efdea099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:46.371862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1391/2770] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:50:46.683343 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3b10-ebdc-477d-acc9-833020ddeb7c service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:46.694022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3b10-ebdc-477d-acc9-833020ddeb7c service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:46.698511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:46.699269 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:46.699613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:46.699949 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:46.704055 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:46.715741 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:46.717198 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:46.727354 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1380/2771] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:50:53.295890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd1af-5730-44a6-80a8-5a24efdea099 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:53.310600 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd1af-5730-44a6-80a8-5a24efdea099 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:53.317815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9420cf-a087-43a1-b37a-758cf20c450e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:53.318553 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9420cf-a087-43a1-b37a-758cf20c450e service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:53.318839 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9420cf-a087-43a1-b37a-758cf20c450e service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:53.319114 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9420cf-a087-43a1-b37a-758cf20c450e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:53.321220 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8c9420cf-a087-43a1-b37a-758cf20c450e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:53.334814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9420cf-a087-43a1-b37a-758cf20c450e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:53.336973 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9420cf-a087-43a1-b37a-758cf20c450e service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:53.348760 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1392/2772] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:50:58.163530 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:50:58.177885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cd830-0278-4537-9094-4fdbef22a8b8 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:50:58.183862 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7263b80be2c437997b1a18002c9969d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:50:58.184549 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:50:58.184828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:50:58.185149 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:50:58.187309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:50:58.206135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:50:58.208369 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:50:58.220287 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1381/2773] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:50:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:52:32.537780 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02462e-79c9-48c8-9769-f6c335b75d3b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:52:32.538405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02462e-79c9-48c8-9769-f6c335b75d3b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:52:32.538405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02462e-79c9-48c8-9769-f6c335b75d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:52:32.573861 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cf02462e-79c9-48c8-9769-f6c335b75d3b None None] MFA Rules not processed for user `bb1a88c50d7f46e297e683e6c7ef033e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:52:32.575055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cf02462e-79c9-48c8-9769-f6c335b75d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:52:32.650121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1393/2774] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:52:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:53:10.568245 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:53:10.629358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98a28-0a79-4d55-8033-0ec0c1d7629a service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:53:10.635046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02938c77178a4f14a33ff1298775687c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:53:10.635689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:53:10.635968 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:53:10.636223 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:53:10.638134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:53:10.663555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:53:10.665138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:53:10.675951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1382/2775] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:53:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:53:37.080579 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860edf-530c-4969-944d-229c7d8d42c5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:53:37.081135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860edf-530c-4969-944d-229c7d8d42c5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:53:37.081135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860edf-530c-4969-944d-229c7d8d42c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:53:37.098687 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8d860edf-530c-4969-944d-229c7d8d42c5 None None] MFA Rules not processed for user `7ca3187ddb684fd1b90463f4adf4282d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:53:37.099877 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8d860edf-530c-4969-944d-229c7d8d42c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:53:37.107191 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1394/2776] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:54:17.725017 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:17.747815 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57bfbd-5804-45a1-bc15-dd0ecd48c3a1 service placement] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:17.752166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:17.752830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:17.753324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:17.753711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:17.756093 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:17.768010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:17.769444 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:17.778732 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1383/2777] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:54:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:54:31.037842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860edf-530c-4969-944d-229c7d8d42c5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:31.049116 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860edf-530c-4969-944d-229c7d8d42c5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:31.052715 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:31.053381 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:31.053698 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:31.053998 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:31.055918 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:31.091588 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:31.093010 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:31.115184 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1395/2778] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:54:37.427210 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:37.428644 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:37.443023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e56c-a86e-415a-8c31-90d5aee5b53e service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:37.447410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:37.448281 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:37.448593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:37.448868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] PATH_INFO: `/v3/users/bb1a88c50d7f46e297e683e6c7ef033e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:37.450085 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1a88c50d7f46e297e683e6c7ef033e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:37.452038 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:37.499232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1a88c50d7f46e297e683e6c7ef033e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.511993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1a88c50d7f46e297e683e6c7ef033e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.512740 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1a88c50d7f46e297e683e6c7ef033e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.513438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1a88c50d7f46e297e683e6c7ef033e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.520437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1a88c50d7f46e297e683e6c7ef033e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.539350 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1384/2779] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:54:37 2022] DELETE /identity/v3/users/bb1a88c50d7f46e297e683e6c7ef033e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:37.722148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:37.732334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b3443-28fe-466f-97e2-8ee5c72a1290 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:37.793066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:37.794332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:37.794610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:37.794880 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] PATH_INFO: `/v3/projects/782ab44dbedd4b94b6c8fb2414a51a79` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:37.796247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782ab44dbedd4b94b6c8fb2414a51a79)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:37.798379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:37.847831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782ab44dbedd4b94b6c8fb2414a51a79', 'request_id': 'req-99dac7ca-2444-49c3-984f-0df0fa4516c3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.854037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782ab44dbedd4b94b6c8fb2414a51a79', 'request_id': 'req-99dac7ca-2444-49c3-984f-0df0fa4516c3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.862012 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782ab44dbedd4b94b6c8fb2414a51a79', 'request_id': 'req-99dac7ca-2444-49c3-984f-0df0fa4516c3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.872982 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] The token cache is being invalidate because project 782ab44dbedd4b94b6c8fb2414a51a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:54:37.873265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.873971 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:37.875499 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1396/2780] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:54:37 2022] DELETE /identity/v3/projects/782ab44dbedd4b94b6c8fb2414a51a79 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:37.879504 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:37.880935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:37.893940 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b69bb3-9d86-4286-aac3-f8553695b04f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:37.948516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:37.949402 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:37.949762 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:37.950065 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] PATH_INFO: `/v3/users/38123a952999418d8fba6f0c8e8ded6c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:37.951521 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38123a952999418d8fba6f0c8e8ded6c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:37.953839 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:38.002434 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38123a952999418d8fba6f0c8e8ded6c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.014660 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38123a952999418d8fba6f0c8e8ded6c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.015367 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38123a952999418d8fba6f0c8e8ded6c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.015969 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38123a952999418d8fba6f0c8e8ded6c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.022555 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38123a952999418d8fba6f0c8e8ded6c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.036605 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1385/2781] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:54:37 2022] DELETE /identity/v3/users/38123a952999418d8fba6f0c8e8ded6c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:38.210274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:38.211771 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:38.225057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dac7ca-2444-49c3-984f-0df0fa4516c3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:38.281480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:38.282386 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:38.282667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:38.282942 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] PATH_INFO: `/v3/projects/38b551e22edf4c559bb9d936361ed9e2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:38.284097 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b551e22edf4c559bb9d936361ed9e2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:38.286080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:38.334910 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b551e22edf4c559bb9d936361ed9e2', 'request_id': 'req-bfa50fba-3f35-4e50-8b2e-288386ab4001'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.340889 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b551e22edf4c559bb9d936361ed9e2', 'request_id': 'req-bfa50fba-3f35-4e50-8b2e-288386ab4001'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.349838 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b551e22edf4c559bb9d936361ed9e2', 'request_id': 'req-bfa50fba-3f35-4e50-8b2e-288386ab4001'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.359907 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] The token cache is being invalidate because project 38b551e22edf4c559bb9d936361ed9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:54:38.360167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.360790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:38.362385 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1397/2782] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:54:38 2022] DELETE /identity/v3/projects/38b551e22edf4c559bb9d936361ed9e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:55.640433 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:55.642943 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:55.656527 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec3e51-638b-4c6c-8521-43707d44f224 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:55.714993 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:55.715889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:55.716167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:55.716440 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] PATH_INFO: `/v3/users/7ca3187ddb684fd1b90463f4adf4282d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:55.717770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca3187ddb684fd1b90463f4adf4282d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:55.719733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:55.771597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca3187ddb684fd1b90463f4adf4282d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:55.783357 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca3187ddb684fd1b90463f4adf4282d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:55.784050 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca3187ddb684fd1b90463f4adf4282d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:55.784608 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca3187ddb684fd1b90463f4adf4282d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:55.791894 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-28f2128d-ab8c-402e-a733-8cf6140d426a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca3187ddb684fd1b90463f4adf4282d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:55.806759 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1386/2783] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:54:55 2022] DELETE /identity/v3/users/7ca3187ddb684fd1b90463f4adf4282d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:55.991688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:55.993218 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:56.005654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50fba-3f35-4e50-8b2e-288386ab4001 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.065790 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.066649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.066928 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.067202 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] PATH_INFO: `/v3/projects/2f074c24f4594fa89de6dfe2e38659c3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.068378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f074c24f4594fa89de6dfe2e38659c3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.070324 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.115908 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f074c24f4594fa89de6dfe2e38659c3', 'request_id': 'req-a8714461-8a61-49d0-baba-f50939c5b7e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:56.121741 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f074c24f4594fa89de6dfe2e38659c3', 'request_id': 'req-a8714461-8a61-49d0-baba-f50939c5b7e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:56.131584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f074c24f4594fa89de6dfe2e38659c3', 'request_id': 'req-a8714461-8a61-49d0-baba-f50939c5b7e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:56.141229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] The token cache is being invalidate because project 2f074c24f4594fa89de6dfe2e38659c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:54:56.141508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:56.142147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a8714461-8a61-49d0-baba-f50939c5b7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:56.143685 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1398/2784] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:54:55 2022] DELETE /identity/v3/projects/2f074c24f4594fa89de6dfe2e38659c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:56.149208 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950ad9-f0f1-4428-b3ff-d98d7cbac2c1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.149604 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950ad9-f0f1-4428-b3ff-d98d7cbac2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.150010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950ad9-f0f1-4428-b3ff-d98d7cbac2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.210695 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c4950ad9-f0f1-4428-b3ff-d98d7cbac2c1 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:54:56.211891 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c4950ad9-f0f1-4428-b3ff-d98d7cbac2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:56.270130 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1387/2785] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:54:56.278167 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a20a-b10a-4e76-8302-9cfa1c2596bf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.278454 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a20a-b10a-4e76-8302-9cfa1c2596bf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.278724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a20a-b10a-4e76-8302-9cfa1c2596bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.309280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5ad7a20a-b10a-4e76-8302-9cfa1c2596bf None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:54:56.311168 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5ad7a20a-b10a-4e76-8302-9cfa1c2596bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:56.319551 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1399/2786] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:54:56.324043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950ad9-f0f1-4428-b3ff-d98d7cbac2c1 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.334410 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950ad9-f0f1-4428-b3ff-d98d7cbac2c1 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.340653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.341304 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.341590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.341887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.342655 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:54:56.342961 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.344603 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.356733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1388/2787] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:54:56.361305 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7a20a-b10a-4e76-8302-9cfa1c2596bf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.370882 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7a20a-b10a-4e76-8302-9cfa1c2596bf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.377419 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00be97f-2b70-482e-9352-b3c8d13848b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.378234 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be97f-2b70-482e-9352-b3c8d13848b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.378494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be97f-2b70-482e-9352-b3c8d13848b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.378779 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be97f-2b70-482e-9352-b3c8d13848b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.379504 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00be97f-2b70-482e-9352-b3c8d13848b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.381411 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00be97f-2b70-482e-9352-b3c8d13848b7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.409378 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1400/2788] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:54:56 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:54:56.413690 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.423825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd146fba-2267-4547-9a5b-88b95a2f67b5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.479116 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cafa04-f2d7-48f1-bd02-9d1a8b33d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.479794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafa04-f2d7-48f1-bd02-9d1a8b33d1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.480049 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafa04-f2d7-48f1-bd02-9d1a8b33d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.480324 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafa04-f2d7-48f1-bd02-9d1a8b33d1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.481016 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cafa04-f2d7-48f1-bd02-9d1a8b33d1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.482956 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cafa04-f2d7-48f1-bd02-9d1a8b33d1d2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.504569 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1389/2789] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:54:56 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:54:56.508784 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00be97f-2b70-482e-9352-b3c8d13848b7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.519527 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00be97f-2b70-482e-9352-b3c8d13848b7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.525314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd132e-0a44-47cd-a9ea-cfdcaa13987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.525968 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd132e-0a44-47cd-a9ea-cfdcaa13987a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.526266 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd132e-0a44-47cd-a9ea-cfdcaa13987a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.526538 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd132e-0a44-47cd-a9ea-cfdcaa13987a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.527274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd132e-0a44-47cd-a9ea-cfdcaa13987a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.528894 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd132e-0a44-47cd-a9ea-cfdcaa13987a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.541117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1401/2790] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:54:56.545297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cafa04-f2d7-48f1-bd02-9d1a8b33d1d2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.555591 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cafa04-f2d7-48f1-bd02-9d1a8b33d1d2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.561305 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b127b-6e2a-4952-b5c0-3dca6fe95c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.562051 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b127b-6e2a-4952-b5c0-3dca6fe95c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.562331 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b127b-6e2a-4952-b5c0-3dca6fe95c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.562601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b127b-6e2a-4952-b5c0-3dca6fe95c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.563333 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b127b-6e2a-4952-b5c0-3dca6fe95c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.564935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b127b-6e2a-4952-b5c0-3dca6fe95c55 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.575353 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1390/2791] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:54:56.579516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd132e-0a44-47cd-a9ea-cfdcaa13987a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.589709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd132e-0a44-47cd-a9ea-cfdcaa13987a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.595280 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531bf4-df15-4f0c-b973-fe98191a3a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.596150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531bf4-df15-4f0c-b973-fe98191a3a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.596426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531bf4-df15-4f0c-b973-fe98191a3a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.596692 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531bf4-df15-4f0c-b973-fe98191a3a58 admin admin] PATH_INFO: `/v3/projects/bd58c5579f424ad7af2367886472616e/users/ea976ac1e5d047329421090e0db5f312/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.611966 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6531bf4-df15-4f0c-b973-fe98191a3a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd58c5579f424ad7af2367886472616e, user_id=ea976ac1e5d047329421090e0db5f312, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.614688 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6531bf4-df15-4f0c-b973-fe98191a3a58 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.630034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1402/2792] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:54:56 2022] PUT /identity/v3/projects/bd58c5579f424ad7af2367886472616e/users/ea976ac1e5d047329421090e0db5f312/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:56.641193 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc5d1a-b10c-482e-9e7d-4fb23c379c49 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.641730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc5d1a-b10c-482e-9e7d-4fb23c379c49 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.641844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc5d1a-b10c-482e-9e7d-4fb23c379c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.669463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-29bc5d1a-b10c-482e-9e7d-4fb23c379c49 None None] MFA Rules not processed for user `ea976ac1e5d047329421090e0db5f312`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:54:56.670826 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-29bc5d1a-b10c-482e-9e7d-4fb23c379c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:56.735784 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1391/2793] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:54:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:54:56.740532 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531bf4-df15-4f0c-b973-fe98191a3a58 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.802002 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531bf4-df15-4f0c-b973-fe98191a3a58 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.807609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7edf-1fb0-44e2-974f-40e4d8647ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.808276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7edf-1fb0-44e2-974f-40e4d8647ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.808548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7edf-1fb0-44e2-974f-40e4d8647ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.808826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7edf-1fb0-44e2-974f-40e4d8647ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.809525 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d7edf-1fb0-44e2-974f-40e4d8647ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.811510 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d7edf-1fb0-44e2-974f-40e4d8647ee1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.837476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1403/2794] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:54:56 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:54:56.841669 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc5d1a-b10c-482e-9e7d-4fb23c379c49 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.852883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc5d1a-b10c-482e-9e7d-4fb23c379c49 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.921742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334fdc7-9749-4a8b-9ecd-94dd9928aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.922421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fdc7-9749-4a8b-9ecd-94dd9928aa1d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.922703 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fdc7-9749-4a8b-9ecd-94dd9928aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.922979 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fdc7-9749-4a8b-9ecd-94dd9928aa1d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.923672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334fdc7-9749-4a8b-9ecd-94dd9928aa1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.925720 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334fdc7-9749-4a8b-9ecd-94dd9928aa1d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.949996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1392/2795] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:54:56 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:54:56.956183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7edf-1fb0-44e2-974f-40e4d8647ee1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:56.968309 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7edf-1fb0-44e2-974f-40e4d8647ee1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:56.974043 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1d74-84ff-47e4-9d3a-aab5a5df2d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:56.974813 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1d74-84ff-47e4-9d3a-aab5a5df2d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:56.975047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1d74-84ff-47e4-9d3a-aab5a5df2d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:56.975302 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1d74-84ff-47e4-9d3a-aab5a5df2d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:56.976024 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a1d74-84ff-47e4-9d3a-aab5a5df2d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:56.977646 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a1d74-84ff-47e4-9d3a-aab5a5df2d15 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:56.991634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1404/2796] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:54:56.998288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334fdc7-9749-4a8b-9ecd-94dd9928aa1d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:57.008636 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334fdc7-9749-4a8b-9ecd-94dd9928aa1d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:57.014318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174412-c80d-4b5e-9013-1ffc64f56d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:57.015195 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174412-c80d-4b5e-9013-1ffc64f56d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:57.015475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174412-c80d-4b5e-9013-1ffc64f56d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:57.015747 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174412-c80d-4b5e-9013-1ffc64f56d96 admin admin] PATH_INFO: `/v3/projects/69c0a2b93ca94dccb147d3a959bd77f7/users/88f2e4418c3d4035a1268f986d74e8aa/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:57.032966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae174412-c80d-4b5e-9013-1ffc64f56d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c0a2b93ca94dccb147d3a959bd77f7, user_id=88f2e4418c3d4035a1268f986d74e8aa, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:57.036864 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae174412-c80d-4b5e-9013-1ffc64f56d96 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:57.055873 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1393/2797] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:54:56 2022] PUT /identity/v3/projects/69c0a2b93ca94dccb147d3a959bd77f7/users/88f2e4418c3d4035a1268f986d74e8aa/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:57.060733 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1d74-84ff-47e4-9d3a-aab5a5df2d15 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:57.071201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1d74-84ff-47e4-9d3a-aab5a5df2d15 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:57.132081 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e6f27-f1a3-4eab-bac4-e37f6b8bbb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:57.132756 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6f27-f1a3-4eab-bac4-e37f6b8bbb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:57.133034 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6f27-f1a3-4eab-bac4-e37f6b8bbb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:57.133308 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6f27-f1a3-4eab-bac4-e37f6b8bbb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:57.134090 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e6f27-f1a3-4eab-bac4-e37f6b8bbb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:57.135722 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e6f27-f1a3-4eab-bac4-e37f6b8bbb7d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:57.145502 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1405/2798] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:54:57.150524 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174412-c80d-4b5e-9013-1ffc64f56d96 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:57.166625 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174412-c80d-4b5e-9013-1ffc64f56d96 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:57.173061 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:57.173966 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:57.174241 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:57.174511 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] PATH_INFO: `/v3/projects/69c0a2b93ca94dccb147d3a959bd77f7/users/88f2e4418c3d4035a1268f986d74e8aa/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:57.176577 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c0a2b93ca94dccb147d3a959bd77f7, user_id=88f2e4418c3d4035a1268f986d74e8aa, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:57.179244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:57.189230 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1394/2799] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:54:57 2022] PUT /identity/v3/projects/69c0a2b93ca94dccb147d3a959bd77f7/users/88f2e4418c3d4035a1268f986d74e8aa/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:57.199367 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65bc4-5db2-4e44-bf2c-611a9081e1ee None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:57.199653 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65bc4-5db2-4e44-bf2c-611a9081e1ee None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:57.199927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65bc4-5db2-4e44-bf2c-611a9081e1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:57.227117 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-19c65bc4-5db2-4e44-bf2c-611a9081e1ee None None] MFA Rules not processed for user `88f2e4418c3d4035a1268f986d74e8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:54:57.228314 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-19c65bc4-5db2-4e44-bf2c-611a9081e1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:57.314724 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1406/2800] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:54:57 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:54:57.325693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:57.327561 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:57.411344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9571fbe-4bee-4215-888c-d67edd173bd6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:57.416045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e389238-8770-43d1-a295-7d7c49a63a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:57.416711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389238-8770-43d1-a295-7d7c49a63a3f service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:57.416990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389238-8770-43d1-a295-7d7c49a63a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:57.417265 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389238-8770-43d1-a295-7d7c49a63a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:57.426722 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e389238-8770-43d1-a295-7d7c49a63a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:57.428147 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e389238-8770-43d1-a295-7d7c49a63a3f service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:57.439914 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1395/2801] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:54:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:54:58.806557 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c65bc4-5db2-4e44-bf2c-611a9081e1ee None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:58.883619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c65bc4-5db2-4e44-bf2c-611a9081e1ee None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:58.889185 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:58.890261 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:58.890542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:58.890814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] PATH_INFO: `/v3/users/ea976ac1e5d047329421090e0db5f312` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:58.892007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea976ac1e5d047329421090e0db5f312)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:58.894246 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:58.944826 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea976ac1e5d047329421090e0db5f312'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:58.957289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea976ac1e5d047329421090e0db5f312'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:58.958038 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea976ac1e5d047329421090e0db5f312'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:58.965180 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea976ac1e5d047329421090e0db5f312'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:58.973917 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea976ac1e5d047329421090e0db5f312'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:58.980548 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1407/2802] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:54:58 2022] DELETE /identity/v3/users/ea976ac1e5d047329421090e0db5f312 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:58.985742 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a84f-f685-4bb3-9686-cdb1f785b176 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:58.986288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a84f-f685-4bb3-9686-cdb1f785b176 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:58.986288 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a84f-f685-4bb3-9686-cdb1f785b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:59.003877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c807a84f-f685-4bb3-9686-cdb1f785b176 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:54:59.005104 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c807a84f-f685-4bb3-9686-cdb1f785b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:59.067821 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1396/2803] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:54:59.079345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:59.081437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:59.168394 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688877f7-38a2-4940-be65-3275b45853d4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:59.173540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccace55-7104-4354-9280-d78e315f813b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:59.174476 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccace55-7104-4354-9280-d78e315f813b service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:59.174737 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccace55-7104-4354-9280-d78e315f813b service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:59.175018 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccace55-7104-4354-9280-d78e315f813b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:59.187643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccace55-7104-4354-9280-d78e315f813b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:59.189135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccace55-7104-4354-9280-d78e315f813b service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:59.198659 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1408/2804] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:54:59.470698 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a84f-f685-4bb3-9686-cdb1f785b176 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:59.472097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c807a84f-f685-4bb3-9686-cdb1f785b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:54:59.486397 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a84f-f685-4bb3-9686-cdb1f785b176 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:59.492463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:59.493237 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:59.493463 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:59.493765 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] PATH_INFO: `/v3/projects/bd58c5579f424ad7af2367886472616e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:59.495062 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd58c5579f424ad7af2367886472616e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:59.496935 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:59.545268 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd58c5579f424ad7af2367886472616e', 'request_id': 'req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.551461 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd58c5579f424ad7af2367886472616e', 'request_id': 'req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.560951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd58c5579f424ad7af2367886472616e', 'request_id': 'req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.570858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] The token cache is being invalidate because project bd58c5579f424ad7af2367886472616e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:54:59.571135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.571822 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.573412 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1397/2805] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:54:59 2022] DELETE /identity/v3/projects/bd58c5579f424ad7af2367886472616e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:54:59.577654 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccace55-7104-4354-9280-d78e315f813b service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:54:59.587635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccace55-7104-4354-9280-d78e315f813b service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:54:59.646831 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:54:59.647735 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:54:59.648014 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:54:59.648294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] PATH_INFO: `/v3/users/88f2e4418c3d4035a1268f986d74e8aa` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:54:59.649584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f2e4418c3d4035a1268f986d74e8aa)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:54:59.651586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:54:59.701423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f2e4418c3d4035a1268f986d74e8aa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.712519 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f2e4418c3d4035a1268f986d74e8aa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.713096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f2e4418c3d4035a1268f986d74e8aa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.719559 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f2e4418c3d4035a1268f986d74e8aa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.727380 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d52fb26-6c7e-4b93-8d50-3ab3a1153a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f2e4418c3d4035a1268f986d74e8aa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:54:59.733858 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1409/2806] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:54:59 2022] DELETE /identity/v3/users/88f2e4418c3d4035a1268f986d74e8aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:00.013711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.015529 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:00.028236 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd6bb-f4af-4001-afaa-bf09ae5b7f26 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.084889 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.085879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.086158 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.086435 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] PATH_INFO: `/v3/projects/69c0a2b93ca94dccb147d3a959bd77f7` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.087642 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c0a2b93ca94dccb147d3a959bd77f7)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.089533 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.134730 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c0a2b93ca94dccb147d3a959bd77f7', 'request_id': 'req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:00.140489 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c0a2b93ca94dccb147d3a959bd77f7', 'request_id': 'req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:00.151279 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c0a2b93ca94dccb147d3a959bd77f7', 'request_id': 'req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:00.161213 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] The token cache is being invalidate because project 69c0a2b93ca94dccb147d3a959bd77f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:55:00.161492 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:00.162141 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4d8aac86-a1f3-4be6-b27f-327eb14fc1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:00.163726 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1398/2807] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:55:00 2022] DELETE /identity/v3/projects/69c0a2b93ca94dccb147d3a959bd77f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:00.169959 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcaa7a-c563-43cf-83f0-115eef168e67 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.170423 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcaa7a-c563-43cf-83f0-115eef168e67 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.170522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcaa7a-c563-43cf-83f0-115eef168e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.191404 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2bdcaa7a-c563-43cf-83f0-115eef168e67 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:00.192602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2bdcaa7a-c563-43cf-83f0-115eef168e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:00.248768 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1410/2808] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:00.257654 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e893f2-c326-45d0-bcd3-677e22cc6407 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.257892 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e893f2-c326-45d0-bcd3-677e22cc6407 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.258165 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e893f2-c326-45d0-bcd3-677e22cc6407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.275975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c8e893f2-c326-45d0-bcd3-677e22cc6407 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:00.277159 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c8e893f2-c326-45d0-bcd3-677e22cc6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:00.286167 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1399/2809] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:00.290540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcaa7a-c563-43cf-83f0-115eef168e67 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.300742 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcaa7a-c563-43cf-83f0-115eef168e67 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.305999 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.306637 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.306915 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.307186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.308000 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:55:00.308290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.309920 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.321268 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1411/2810] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:55:00.328143 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e893f2-c326-45d0-bcd3-677e22cc6407 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.339711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e893f2-c326-45d0-bcd3-677e22cc6407 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.346140 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ef497-6cac-4afd-9c84-e42918283d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.347299 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ef497-6cac-4afd-9c84-e42918283d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.347799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ef497-6cac-4afd-9c84-e42918283d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.348312 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ef497-6cac-4afd-9c84-e42918283d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.349258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ef497-6cac-4afd-9c84-e42918283d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.351217 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ef497-6cac-4afd-9c84-e42918283d46 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.382911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1400/2811] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:55:00 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:00.389574 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.401252 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b7747-4f56-48d8-9e84-607489f0e4da admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.470594 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad73c-b5b4-43fe-a7f3-15afd53e6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.471259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad73c-b5b4-43fe-a7f3-15afd53e6197 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.471487 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad73c-b5b4-43fe-a7f3-15afd53e6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.471793 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad73c-b5b4-43fe-a7f3-15afd53e6197 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.472473 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdad73c-b5b4-43fe-a7f3-15afd53e6197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.474403 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdad73c-b5b4-43fe-a7f3-15afd53e6197 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.500617 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1412/2812] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:55:00 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:00.501915 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ef497-6cac-4afd-9c84-e42918283d46 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.512516 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ef497-6cac-4afd-9c84-e42918283d46 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.516953 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b82e0-b2a7-4e89-8454-a3c87c8e2241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.517645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b82e0-b2a7-4e89-8454-a3c87c8e2241 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.517927 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b82e0-b2a7-4e89-8454-a3c87c8e2241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.518200 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b82e0-b2a7-4e89-8454-a3c87c8e2241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.518925 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b82e0-b2a7-4e89-8454-a3c87c8e2241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.520513 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b82e0-b2a7-4e89-8454-a3c87c8e2241 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.531197 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1401/2813] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:00.535059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad73c-b5b4-43fe-a7f3-15afd53e6197 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.545577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad73c-b5b4-43fe-a7f3-15afd53e6197 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.550702 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36040df5-caf0-4bfd-84aa-90a57439c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.551344 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36040df5-caf0-4bfd-84aa-90a57439c490 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.551644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36040df5-caf0-4bfd-84aa-90a57439c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.551913 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36040df5-caf0-4bfd-84aa-90a57439c490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.552631 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36040df5-caf0-4bfd-84aa-90a57439c490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.554297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36040df5-caf0-4bfd-84aa-90a57439c490 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.564458 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1413/2814] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:00.569271 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b82e0-b2a7-4e89-8454-a3c87c8e2241 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.584973 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b82e0-b2a7-4e89-8454-a3c87c8e2241 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.593376 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5483-b862-4391-9037-f8a5fc58d8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.594285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5483-b862-4391-9037-f8a5fc58d8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.594571 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5483-b862-4391-9037-f8a5fc58d8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.594849 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5483-b862-4391-9037-f8a5fc58d8a4 admin admin] PATH_INFO: `/v3/projects/113381584bc140e09bdb071cf64d5cef/users/cdb4d6a691e347cebdcb49d67df52830/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.610162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da5483-b862-4391-9037-f8a5fc58d8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113381584bc140e09bdb071cf64d5cef, user_id=cdb4d6a691e347cebdcb49d67df52830, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.613004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da5483-b862-4391-9037-f8a5fc58d8a4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.628519 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1402/2815] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:00 2022] PUT /identity/v3/projects/113381584bc140e09bdb071cf64d5cef/users/cdb4d6a691e347cebdcb49d67df52830/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:00.639007 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95154f-fc51-4b59-9568-a3d99f6e677b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.639297 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95154f-fc51-4b59-9568-a3d99f6e677b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.639570 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95154f-fc51-4b59-9568-a3d99f6e677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.666069 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3c95154f-fc51-4b59-9568-a3d99f6e677b None None] MFA Rules not processed for user `cdb4d6a691e347cebdcb49d67df52830`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:00.667276 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3c95154f-fc51-4b59-9568-a3d99f6e677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:00.746139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1414/2816] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:00.747923 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5483-b862-4391-9037-f8a5fc58d8a4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.810482 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5483-b862-4391-9037-f8a5fc58d8a4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.816303 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174b2bd-5480-48f5-9a06-ba98b3846922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.816955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174b2bd-5480-48f5-9a06-ba98b3846922 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.817262 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174b2bd-5480-48f5-9a06-ba98b3846922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.817537 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174b2bd-5480-48f5-9a06-ba98b3846922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.818251 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174b2bd-5480-48f5-9a06-ba98b3846922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.820181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174b2bd-5480-48f5-9a06-ba98b3846922 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.847548 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1403/2817] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:55:00 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:55:00.852284 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95154f-fc51-4b59-9568-a3d99f6e677b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.868311 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95154f-fc51-4b59-9568-a3d99f6e677b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.926807 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391420a-4229-44b2-82be-5baaaf5b8ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.927471 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391420a-4229-44b2-82be-5baaaf5b8ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.927748 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391420a-4229-44b2-82be-5baaaf5b8ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.928050 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391420a-4229-44b2-82be-5baaaf5b8ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.928728 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391420a-4229-44b2-82be-5baaaf5b8ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.930684 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391420a-4229-44b2-82be-5baaaf5b8ff1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.952903 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1415/2818] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:55:00 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:00.957345 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174b2bd-5480-48f5-9a06-ba98b3846922 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:00.968247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174b2bd-5480-48f5-9a06-ba98b3846922 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:00.974054 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b12a-0054-4d61-88eb-fcc871fe3b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:00.974715 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b12a-0054-4d61-88eb-fcc871fe3b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:00.974998 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b12a-0054-4d61-88eb-fcc871fe3b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:00.975266 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b12a-0054-4d61-88eb-fcc871fe3b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:00.976023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b12a-0054-4d61-88eb-fcc871fe3b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:00.977651 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b12a-0054-4d61-88eb-fcc871fe3b0a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:00.988431 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1404/2819] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:55:00.992623 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391420a-4229-44b2-82be-5baaaf5b8ff1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:01.002405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391420a-4229-44b2-82be-5baaaf5b8ff1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:01.007055 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07a58-03f9-4cdf-a994-70b76aa1c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:01.007911 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07a58-03f9-4cdf-a994-70b76aa1c8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:01.008231 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07a58-03f9-4cdf-a994-70b76aa1c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:01.008507 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07a58-03f9-4cdf-a994-70b76aa1c8ac admin admin] PATH_INFO: `/v3/projects/61046f67659d497290fddb2c9aa8c21e/users/899f89635b544f1d8abe075f574429ad/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:01.029644 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d07a58-03f9-4cdf-a994-70b76aa1c8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=61046f67659d497290fddb2c9aa8c21e, user_id=899f89635b544f1d8abe075f574429ad, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:01.032479 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d07a58-03f9-4cdf-a994-70b76aa1c8ac admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:01.047876 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1416/2820] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:00 2022] PUT /identity/v3/projects/61046f67659d497290fddb2c9aa8c21e/users/899f89635b544f1d8abe075f574429ad/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:55:01.051996 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b12a-0054-4d61-88eb-fcc871fe3b0a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:01.062347 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b12a-0054-4d61-88eb-fcc871fe3b0a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:01.120588 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4a96e-bd0d-4c88-b604-0cf0dd2bd2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:01.121247 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a96e-bd0d-4c88-b604-0cf0dd2bd2cc admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:01.121600 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a96e-bd0d-4c88-b604-0cf0dd2bd2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:01.121859 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a96e-bd0d-4c88-b604-0cf0dd2bd2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:01.122585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a96e-bd0d-4c88-b604-0cf0dd2bd2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:01.124234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a96e-bd0d-4c88-b604-0cf0dd2bd2cc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:01.134585 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1405/2821] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:01.138900 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07a58-03f9-4cdf-a994-70b76aa1c8ac admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:01.151795 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07a58-03f9-4cdf-a994-70b76aa1c8ac admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:01.160205 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:01.161514 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:01.161921 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:01.162201 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] PATH_INFO: `/v3/projects/61046f67659d497290fddb2c9aa8c21e/users/899f89635b544f1d8abe075f574429ad/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:01.165602 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61046f67659d497290fddb2c9aa8c21e, user_id=899f89635b544f1d8abe075f574429ad, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:01.170392 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:01.182037 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1417/2822] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:01 2022] PUT /identity/v3/projects/61046f67659d497290fddb2c9aa8c21e/users/899f89635b544f1d8abe075f574429ad/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:01.192413 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f05b18-a377-4f1c-90d8-d896fa59ad38 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:01.192735 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f05b18-a377-4f1c-90d8-d896fa59ad38 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:01.193046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f05b18-a377-4f1c-90d8-d896fa59ad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:01.221446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-31f05b18-a377-4f1c-90d8-d896fa59ad38 None None] MFA Rules not processed for user `899f89635b544f1d8abe075f574429ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:01.222674 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-31f05b18-a377-4f1c-90d8-d896fa59ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:01.289828 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1406/2823] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:01.304518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:01.307143 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:01.367841 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3286fc3-5397-4683-99e0-c4a1420f6eb4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:01.373969 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac297d-6e73-43de-ba10-de06dfae4eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:01.374720 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac297d-6e73-43de-ba10-de06dfae4eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:01.375003 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac297d-6e73-43de-ba10-de06dfae4eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:01.375270 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac297d-6e73-43de-ba10-de06dfae4eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:01.384738 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac297d-6e73-43de-ba10-de06dfae4eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:01.386224 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac297d-6e73-43de-ba10-de06dfae4eb2 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:01.395749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1418/2824] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:01.449026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f05b18-a377-4f1c-90d8-d896fa59ad38 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:01.450607 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-31f05b18-a377-4f1c-90d8-d896fa59ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:01.463634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f05b18-a377-4f1c-90d8-d896fa59ad38 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:01.467883 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859acf86-72d0-4e23-b5d1-668f99c84a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:01.468595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859acf86-72d0-4e23-b5d1-668f99c84a1a service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:01.468876 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859acf86-72d0-4e23-b5d1-668f99c84a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:01.469138 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859acf86-72d0-4e23-b5d1-668f99c84a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:01.536132 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859acf86-72d0-4e23-b5d1-668f99c84a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:01.537580 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859acf86-72d0-4e23-b5d1-668f99c84a1a service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:01.547029 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1407/2825] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:04.876958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac297d-6e73-43de-ba10-de06dfae4eb2 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:04.941148 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac297d-6e73-43de-ba10-de06dfae4eb2 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:04.946139 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:04.947080 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:04.947345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:04.947643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] PATH_INFO: `/v3/users/cdb4d6a691e347cebdcb49d67df52830` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:04.948993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb4d6a691e347cebdcb49d67df52830)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:04.951016 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:04.999586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb4d6a691e347cebdcb49d67df52830'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.011516 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb4d6a691e347cebdcb49d67df52830'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.012338 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb4d6a691e347cebdcb49d67df52830'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.020259 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb4d6a691e347cebdcb49d67df52830'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.031434 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb4d6a691e347cebdcb49d67df52830'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.037634 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1419/2826] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:55:04 2022] DELETE /identity/v3/users/cdb4d6a691e347cebdcb49d67df52830 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:05.042842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af704-767a-437a-84f1-8b9ce00baae6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:05.043348 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af704-767a-437a-84f1-8b9ce00baae6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:05.043460 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af704-767a-437a-84f1-8b9ce00baae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:05.060486 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6d6af704-767a-437a-84f1-8b9ce00baae6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:05.061773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6d6af704-767a-437a-84f1-8b9ce00baae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:05.121574 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1408/2827] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:05.131501 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:05.133104 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:05.195587 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62caf201-246b-4f02-a869-a0fe239e7307 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:05.199855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028360-0e5a-41f1-90ed-23a259c330a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:05.200508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028360-0e5a-41f1-90ed-23a259c330a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:05.200761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028360-0e5a-41f1-90ed-23a259c330a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:05.201060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028360-0e5a-41f1-90ed-23a259c330a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:05.214091 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8028360-0e5a-41f1-90ed-23a259c330a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:05.216327 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8028360-0e5a-41f1-90ed-23a259c330a0 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:05.231291 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1420/2828] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:05.527399 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6af704-767a-437a-84f1-8b9ce00baae6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:05.529196 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6d6af704-767a-437a-84f1-8b9ce00baae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:05.542124 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6af704-767a-437a-84f1-8b9ce00baae6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:05.547535 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:05.548505 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:05.548802 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:05.549145 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] PATH_INFO: `/v3/projects/113381584bc140e09bdb071cf64d5cef` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:05.550672 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113381584bc140e09bdb071cf64d5cef)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:05.552704 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:05.605027 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113381584bc140e09bdb071cf64d5cef', 'request_id': 'req-517ffa5c-b073-40db-a90a-c0c05969abc8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.611501 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113381584bc140e09bdb071cf64d5cef', 'request_id': 'req-517ffa5c-b073-40db-a90a-c0c05969abc8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.621166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113381584bc140e09bdb071cf64d5cef', 'request_id': 'req-517ffa5c-b073-40db-a90a-c0c05969abc8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.631723 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] The token cache is being invalidate because project 113381584bc140e09bdb071cf64d5cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:55:05.631995 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.632613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.634181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1409/2829] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:55:05 2022] DELETE /identity/v3/projects/113381584bc140e09bdb071cf64d5cef => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:05.638485 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028360-0e5a-41f1-90ed-23a259c330a0 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:05.649060 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028360-0e5a-41f1-90ed-23a259c330a0 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:05.710636 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:05.711703 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:05.712066 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:05.712345 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] PATH_INFO: `/v3/users/899f89635b544f1d8abe075f574429ad` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:05.713577 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899f89635b544f1d8abe075f574429ad)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:05.715936 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:05.776366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899f89635b544f1d8abe075f574429ad'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.789019 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899f89635b544f1d8abe075f574429ad'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.789850 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899f89635b544f1d8abe075f574429ad'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.797098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899f89635b544f1d8abe075f574429ad'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.806802 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-34cf1880-9b93-459b-9c9a-c4346b19ca14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899f89635b544f1d8abe075f574429ad'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:05.815700 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1421/2830] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:55:05 2022] DELETE /identity/v3/users/899f89635b544f1d8abe075f574429ad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:06.095023 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.096700 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:06.110418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ffa5c-b073-40db-a90a-c0c05969abc8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:06.168579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:06.169388 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.169689 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.169955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] PATH_INFO: `/v3/projects/61046f67659d497290fddb2c9aa8c21e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.171171 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61046f67659d497290fddb2c9aa8c21e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:06.173058 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:06.217103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61046f67659d497290fddb2c9aa8c21e', 'request_id': 'req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:06.223244 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61046f67659d497290fddb2c9aa8c21e', 'request_id': 'req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:06.233071 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61046f67659d497290fddb2c9aa8c21e', 'request_id': 'req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:06.243634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] The token cache is being invalidate because project 61046f67659d497290fddb2c9aa8c21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:55:06.243917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:06.244601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-864bbc7c-48fa-4ffc-ab28-39a55d18e60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:06.246293 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1410/2831] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:55:06 2022] DELETE /identity/v3/projects/61046f67659d497290fddb2c9aa8c21e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:06.251539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b232598-ef96-48da-95f3-83e00c6776f8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.252086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b232598-ef96-48da-95f3-83e00c6776f8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.252086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b232598-ef96-48da-95f3-83e00c6776f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.269655 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2b232598-ef96-48da-95f3-83e00c6776f8 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:06.270837 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2b232598-ef96-48da-95f3-83e00c6776f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:06.337747 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1422/2832] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:06.400097 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f0fcb-f021-4704-a182-bceff57dd628 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.400379 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f0fcb-f021-4704-a182-bceff57dd628 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.400652 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f0fcb-f021-4704-a182-bceff57dd628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.420000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-819f0fcb-f021-4704-a182-bceff57dd628 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:06.421128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-819f0fcb-f021-4704-a182-bceff57dd628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:06.429144 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1411/2833] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:06.433426 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b232598-ef96-48da-95f3-83e00c6776f8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.443100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b232598-ef96-48da-95f3-83e00c6776f8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:06.448147 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:06.448794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.449071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.449336 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.450115 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:55:06.450397 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:06.451981 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:06.463161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1423/2834] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:55:06.467337 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f0fcb-f021-4704-a182-bceff57dd628 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.477344 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f0fcb-f021-4704-a182-bceff57dd628 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:06.483009 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e0388-02c8-413a-b086-b5c8cd271fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:06.483663 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0388-02c8-413a-b086-b5c8cd271fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.483944 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0388-02c8-413a-b086-b5c8cd271fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.484218 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0388-02c8-413a-b086-b5c8cd271fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.484990 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e0388-02c8-413a-b086-b5c8cd271fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:06.486955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e0388-02c8-413a-b086-b5c8cd271fa7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:06.515948 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1412/2835] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:55:06 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:06.522410 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.537958 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ad75-db15-4a8f-a888-cb2dcf18aa9d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:06.599546 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488997c-5ce9-4f8b-8aa0-e5f6196a7385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:06.600209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488997c-5ce9-4f8b-8aa0-e5f6196a7385 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.600513 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488997c-5ce9-4f8b-8aa0-e5f6196a7385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.600753 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488997c-5ce9-4f8b-8aa0-e5f6196a7385 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.601427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488997c-5ce9-4f8b-8aa0-e5f6196a7385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:06.603456 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488997c-5ce9-4f8b-8aa0-e5f6196a7385 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:06.624815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1424/2836] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:55:06 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:06.628963 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e0388-02c8-413a-b086-b5c8cd271fa7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.639851 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e0388-02c8-413a-b086-b5c8cd271fa7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:06.645687 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16798a1a-fe27-48e6-8c36-cb4eecbb7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:06.646352 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16798a1a-fe27-48e6-8c36-cb4eecbb7c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.646634 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16798a1a-fe27-48e6-8c36-cb4eecbb7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.646906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16798a1a-fe27-48e6-8c36-cb4eecbb7c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.647632 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16798a1a-fe27-48e6-8c36-cb4eecbb7c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:06.649238 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16798a1a-fe27-48e6-8c36-cb4eecbb7c73 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:06.668421 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1413/2837] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:06.672618 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488997c-5ce9-4f8b-8aa0-e5f6196a7385 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.683135 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488997c-5ce9-4f8b-8aa0-e5f6196a7385 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:06.688673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f4f2-60ee-4270-b4f1-0613b6e33844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:06.689334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f4f2-60ee-4270-b4f1-0613b6e33844 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.689665 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f4f2-60ee-4270-b4f1-0613b6e33844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.689916 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f4f2-60ee-4270-b4f1-0613b6e33844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.690635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4f4f2-60ee-4270-b4f1-0613b6e33844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:06.692258 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4f4f2-60ee-4270-b4f1-0613b6e33844 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:06.702844 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1425/2838] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:06.707228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16798a1a-fe27-48e6-8c36-cb4eecbb7c73 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.717711 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16798a1a-fe27-48e6-8c36-cb4eecbb7c73 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:06.723275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6163f-3dd6-4105-b2b4-9327b4ca0bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:06.724161 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6163f-3dd6-4105-b2b4-9327b4ca0bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.724425 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6163f-3dd6-4105-b2b4-9327b4ca0bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.724693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6163f-3dd6-4105-b2b4-9327b4ca0bdb admin admin] PATH_INFO: `/v3/projects/eee511e7c2c24d06b7d2a149c0a30090/users/ff13216f7ec04159aa376a529f0682be/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.740048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6163f-3dd6-4105-b2b4-9327b4ca0bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee511e7c2c24d06b7d2a149c0a30090, user_id=ff13216f7ec04159aa376a529f0682be, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:06.742743 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6163f-3dd6-4105-b2b4-9327b4ca0bdb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:06.757945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1414/2839] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:06 2022] PUT /identity/v3/projects/eee511e7c2c24d06b7d2a149c0a30090/users/ff13216f7ec04159aa376a529f0682be/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:55:06.769001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257e78-af3e-42d0-a069-d6628e06ca7d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.769290 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257e78-af3e-42d0-a069-d6628e06ca7d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.769584 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257e78-af3e-42d0-a069-d6628e06ca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.796028 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-aa257e78-af3e-42d0-a069-d6628e06ca7d None None] MFA Rules not processed for user `ff13216f7ec04159aa376a529f0682be`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:06.797209 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aa257e78-af3e-42d0-a069-d6628e06ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:06.858047 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1426/2840] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:06.863285 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6163f-3dd6-4105-b2b4-9327b4ca0bdb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.929153 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6163f-3dd6-4105-b2b4-9327b4ca0bdb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:06.935053 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626bae3-ca60-4723-8292-d1aca39c4a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:06.935702 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626bae3-ca60-4723-8292-d1aca39c4a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:06.935975 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626bae3-ca60-4723-8292-d1aca39c4a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:06.936240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626bae3-ca60-4723-8292-d1aca39c4a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:06.936911 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626bae3-ca60-4723-8292-d1aca39c4a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:06.938920 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626bae3-ca60-4723-8292-d1aca39c4a8d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:06.967898 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1415/2841] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:55:06 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:55:06.972360 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa257e78-af3e-42d0-a069-d6628e06ca7d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:06.983058 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa257e78-af3e-42d0-a069-d6628e06ca7d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.038407 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b8653-1481-4ee5-9edf-235aa0083753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.039057 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b8653-1481-4ee5-9edf-235aa0083753 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.039301 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b8653-1481-4ee5-9edf-235aa0083753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.039599 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b8653-1481-4ee5-9edf-235aa0083753 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.040265 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b8653-1481-4ee5-9edf-235aa0083753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.042508 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b8653-1481-4ee5-9edf-235aa0083753 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.065017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1427/2842] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:55:06 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:07.070682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626bae3-ca60-4723-8292-d1aca39c4a8d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.081699 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626bae3-ca60-4723-8292-d1aca39c4a8d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.087824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a205d71-75d2-4ffe-a252-546e422ddadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.088485 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a205d71-75d2-4ffe-a252-546e422ddadb admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.088771 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a205d71-75d2-4ffe-a252-546e422ddadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.089043 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a205d71-75d2-4ffe-a252-546e422ddadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.089879 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a205d71-75d2-4ffe-a252-546e422ddadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.091483 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a205d71-75d2-4ffe-a252-546e422ddadb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.102972 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1416/2843] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:07.107160 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b8653-1481-4ee5-9edf-235aa0083753 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.120522 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b8653-1481-4ee5-9edf-235aa0083753 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.129255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea9b48-2311-407a-9aea-8ce39ea4eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.130343 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9b48-2311-407a-9aea-8ce39ea4eb0e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.130977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9b48-2311-407a-9aea-8ce39ea4eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.130977 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9b48-2311-407a-9aea-8ce39ea4eb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.131603 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea9b48-2311-407a-9aea-8ce39ea4eb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.133972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea9b48-2311-407a-9aea-8ce39ea4eb0e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.146988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1428/2844] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:07.151886 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a205d71-75d2-4ffe-a252-546e422ddadb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.163858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a205d71-75d2-4ffe-a252-546e422ddadb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.169900 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0685a4-7c5e-4bc5-b60d-e1287430a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.170758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0685a4-7c5e-4bc5-b60d-e1287430a022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.171030 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0685a4-7c5e-4bc5-b60d-e1287430a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.171302 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0685a4-7c5e-4bc5-b60d-e1287430a022 admin admin] PATH_INFO: `/v3/projects/a58d0423e6dc4c9481f0015798fa0511/users/12c11b50fcc84549966e7b49e2ffc9b0/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.186647 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0685a4-7c5e-4bc5-b60d-e1287430a022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58d0423e6dc4c9481f0015798fa0511, user_id=12c11b50fcc84549966e7b49e2ffc9b0, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.189318 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0685a4-7c5e-4bc5-b60d-e1287430a022 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.206095 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1417/2845] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:07 2022] PUT /identity/v3/projects/a58d0423e6dc4c9481f0015798fa0511/users/12c11b50fcc84549966e7b49e2ffc9b0/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:07.219542 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b5a24-a02b-4376-9f7d-d61bfa01d5cf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.219822 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b5a24-a02b-4376-9f7d-d61bfa01d5cf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.220086 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b5a24-a02b-4376-9f7d-d61bfa01d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.248438 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-111b5a24-a02b-4376-9f7d-d61bfa01d5cf None None] MFA Rules not processed for user `12c11b50fcc84549966e7b49e2ffc9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:07.249755 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-111b5a24-a02b-4376-9f7d-d61bfa01d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:07.320175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1429/2846] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:07.326064 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0685a4-7c5e-4bc5-b60d-e1287430a022 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.394128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0685a4-7c5e-4bc5-b60d-e1287430a022 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.400026 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aba8e-5c3c-4ce7-90c7-acaf789d0845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.400683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aba8e-5c3c-4ce7-90c7-acaf789d0845 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.400962 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aba8e-5c3c-4ce7-90c7-acaf789d0845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.401206 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aba8e-5c3c-4ce7-90c7-acaf789d0845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.401931 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aba8e-5c3c-4ce7-90c7-acaf789d0845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.403837 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aba8e-5c3c-4ce7-90c7-acaf789d0845 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.438010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1418/2847] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:55:07 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:07.443610 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b5a24-a02b-4376-9f7d-d61bfa01d5cf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.455399 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b5a24-a02b-4376-9f7d-d61bfa01d5cf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.529328 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e42d18-b011-4a20-974c-79cea3319e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.530150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42d18-b011-4a20-974c-79cea3319e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.530432 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42d18-b011-4a20-974c-79cea3319e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.530693 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42d18-b011-4a20-974c-79cea3319e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.531393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e42d18-b011-4a20-974c-79cea3319e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.533320 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e42d18-b011-4a20-974c-79cea3319e12 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.555862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1430/2848] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:55:07 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:07.560168 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aba8e-5c3c-4ce7-90c7-acaf789d0845 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.570942 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aba8e-5c3c-4ce7-90c7-acaf789d0845 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.576479 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e73aa9-5255-42c6-9072-305ab186cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.577136 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73aa9-5255-42c6-9072-305ab186cb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.577416 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73aa9-5255-42c6-9072-305ab186cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.577708 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73aa9-5255-42c6-9072-305ab186cb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.578498 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e73aa9-5255-42c6-9072-305ab186cb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.580296 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e73aa9-5255-42c6-9072-305ab186cb6e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.591878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1419/2849] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:07.596064 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e42d18-b011-4a20-974c-79cea3319e12 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.606294 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e42d18-b011-4a20-974c-79cea3319e12 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.611649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99862-3ae3-44f8-9b3a-d4212ea785e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.612518 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99862-3ae3-44f8-9b3a-d4212ea785e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.612795 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99862-3ae3-44f8-9b3a-d4212ea785e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.613059 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99862-3ae3-44f8-9b3a-d4212ea785e3 admin admin] PATH_INFO: `/v3/projects/e202eee2e76c4c3cb019e045ef1ffa79/users/7b29ba3dc0504922b13f0c43e853c6f6/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.628214 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e99862-3ae3-44f8-9b3a-d4212ea785e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e202eee2e76c4c3cb019e045ef1ffa79, user_id=7b29ba3dc0504922b13f0c43e853c6f6, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.630883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e99862-3ae3-44f8-9b3a-d4212ea785e3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.645480 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1431/2850] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:07 2022] PUT /identity/v3/projects/e202eee2e76c4c3cb019e045ef1ffa79/users/7b29ba3dc0504922b13f0c43e853c6f6/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:07.649616 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e73aa9-5255-42c6-9072-305ab186cb6e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.659945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e73aa9-5255-42c6-9072-305ab186cb6e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.722693 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a4d2c-579c-4128-b85c-0e3eb46b7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.723260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a4d2c-579c-4128-b85c-0e3eb46b7480 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.723540 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a4d2c-579c-4128-b85c-0e3eb46b7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.723812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a4d2c-579c-4128-b85c-0e3eb46b7480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.724534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a4d2c-579c-4128-b85c-0e3eb46b7480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.726192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a4d2c-579c-4128-b85c-0e3eb46b7480 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.735597 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1420/2851] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:07.740039 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99862-3ae3-44f8-9b3a-d4212ea785e3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.751154 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99862-3ae3-44f8-9b3a-d4212ea785e3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.756070 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.756949 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.757229 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.757630 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] PATH_INFO: `/v3/projects/e202eee2e76c4c3cb019e045ef1ffa79/users/7b29ba3dc0504922b13f0c43e853c6f6/roles/32f2dacc897642adb3cc1fab4d3b8202` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.760048 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e202eee2e76c4c3cb019e045ef1ffa79, user_id=7b29ba3dc0504922b13f0c43e853c6f6, role_id=32f2dacc897642adb3cc1fab4d3b8202)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.763668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.774431 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1432/2852] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:07 2022] PUT /identity/v3/projects/e202eee2e76c4c3cb019e045ef1ffa79/users/7b29ba3dc0504922b13f0c43e853c6f6/roles/32f2dacc897642adb3cc1fab4d3b8202 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:07.785887 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52347eb-f8f7-42a8-84c4-db99bd6f9b69 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.786178 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52347eb-f8f7-42a8-84c4-db99bd6f9b69 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.786454 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52347eb-f8f7-42a8-84c4-db99bd6f9b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.816905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e52347eb-f8f7-42a8-84c4-db99bd6f9b69 None None] MFA Rules not processed for user `7b29ba3dc0504922b13f0c43e853c6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:07.818135 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e52347eb-f8f7-42a8-84c4-db99bd6f9b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:07.890351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1421/2853] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:55:07.902263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:07.905286 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:07.967506 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086adaa-224a-463d-92f5-b414693afa4a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:07.971761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff141-0296-4054-bcbb-8a52f53f9f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:07.972439 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff141-0296-4054-bcbb-8a52f53f9f66 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:07.972776 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff141-0296-4054-bcbb-8a52f53f9f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:07.972988 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff141-0296-4054-bcbb-8a52f53f9f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:07.983056 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ff141-0296-4054-bcbb-8a52f53f9f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:07.984494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ff141-0296-4054-bcbb-8a52f53f9f66 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:07.994377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1433/2854] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:08.491393 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52347eb-f8f7-42a8-84c4-db99bd6f9b69 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:08.493462 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e52347eb-f8f7-42a8-84c4-db99bd6f9b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:08.508919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52347eb-f8f7-42a8-84c4-db99bd6f9b69 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:08.513446 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fb45b-4bf6-443d-aaae-309909f563cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:08.514092 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fb45b-4bf6-443d-aaae-309909f563cf service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:08.514364 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fb45b-4bf6-443d-aaae-309909f563cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:08.514638 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fb45b-4bf6-443d-aaae-309909f563cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:08.571885 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fb45b-4bf6-443d-aaae-309909f563cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:08.573309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fb45b-4bf6-443d-aaae-309909f563cf service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:08.582325 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1422/2855] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:12.632072 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff141-0296-4054-bcbb-8a52f53f9f66 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:12.641321 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff141-0296-4054-bcbb-8a52f53f9f66 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:12.645126 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bc963-981f-4274-afd3-3477f056d654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:12.645794 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc963-981f-4274-afd3-3477f056d654 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:12.646071 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc963-981f-4274-afd3-3477f056d654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:12.646341 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc963-981f-4274-afd3-3477f056d654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:12.712101 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bc963-981f-4274-afd3-3477f056d654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:12.713643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bc963-981f-4274-afd3-3477f056d654 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:12.723288 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1434/2856] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:14.863854 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fb45b-4bf6-443d-aaae-309909f563cf service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:14.928788 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fb45b-4bf6-443d-aaae-309909f563cf service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:14.934078 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:14.935004 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:14.935258 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:14.935534 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] PATH_INFO: `/v3/users/ff13216f7ec04159aa376a529f0682be` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:14.936758 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff13216f7ec04159aa376a529f0682be)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:14.938763 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:14.990581 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff13216f7ec04159aa376a529f0682be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.002246 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff13216f7ec04159aa376a529f0682be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.002905 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff13216f7ec04159aa376a529f0682be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.003598 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff13216f7ec04159aa376a529f0682be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.010263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff13216f7ec04159aa376a529f0682be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.023814 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1423/2857] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:55:14 2022] DELETE /identity/v3/users/ff13216f7ec04159aa376a529f0682be => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:15.028503 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfb24-abc0-4ec0-a74e-599179c1d7c6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:15.028976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfb24-abc0-4ec0-a74e-599179c1d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:15.029094 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfb24-abc0-4ec0-a74e-599179c1d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:15.047970 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9a8bfb24-abc0-4ec0-a74e-599179c1d7c6 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:15.049996 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9a8bfb24-abc0-4ec0-a74e-599179c1d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:15.114815 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1435/2858] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:15.126260 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:15.127816 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:15.187465 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497eda7-abfe-4b38-a0e3-e87ab88fcb1d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:15.192175 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377477a-e47b-4984-b637-2123a85f0efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:15.192825 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377477a-e47b-4984-b637-2123a85f0efd service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:15.193081 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377477a-e47b-4984-b637-2123a85f0efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:15.193382 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377477a-e47b-4984-b637-2123a85f0efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:15.203045 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377477a-e47b-4984-b637-2123a85f0efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:15.204547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377477a-e47b-4984-b637-2123a85f0efd service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:15.214571 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1424/2859] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:15.501767 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bfb24-abc0-4ec0-a74e-599179c1d7c6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:15.503847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9a8bfb24-abc0-4ec0-a74e-599179c1d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:15.520469 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bfb24-abc0-4ec0-a74e-599179c1d7c6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:15.525313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:15.526189 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:15.526437 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:15.526732 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] PATH_INFO: `/v3/projects/eee511e7c2c24d06b7d2a149c0a30090` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:15.527951 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee511e7c2c24d06b7d2a149c0a30090)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:15.529862 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:15.584669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee511e7c2c24d06b7d2a149c0a30090', 'request_id': 'req-8a42491e-8542-49ab-b2df-1dae065a30df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.590817 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee511e7c2c24d06b7d2a149c0a30090', 'request_id': 'req-8a42491e-8542-49ab-b2df-1dae065a30df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.599847 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee511e7c2c24d06b7d2a149c0a30090', 'request_id': 'req-8a42491e-8542-49ab-b2df-1dae065a30df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.611096 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] The token cache is being invalidate because project eee511e7c2c24d06b7d2a149c0a30090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:55:15.611377 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.612026 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.613699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1436/2860] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:55:15 2022] DELETE /identity/v3/projects/eee511e7c2c24d06b7d2a149c0a30090 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:15.617989 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377477a-e47b-4984-b637-2123a85f0efd service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:15.627955 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377477a-e47b-4984-b637-2123a85f0efd service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:15.686334 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:15.687228 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:15.687508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:15.687782 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] PATH_INFO: `/v3/users/12c11b50fcc84549966e7b49e2ffc9b0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:15.688992 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c11b50fcc84549966e7b49e2ffc9b0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:15.690950 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:15.736980 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c11b50fcc84549966e7b49e2ffc9b0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.748250 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c11b50fcc84549966e7b49e2ffc9b0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.748906 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c11b50fcc84549966e7b49e2ffc9b0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.749538 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c11b50fcc84549966e7b49e2ffc9b0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.756291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c11b50fcc84549966e7b49e2ffc9b0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:15.770770 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1425/2861] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:55:15 2022] DELETE /identity/v3/users/12c11b50fcc84549966e7b49e2ffc9b0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:16.044366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:16.045866 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:16.058978 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42491e-8542-49ab-b2df-1dae065a30df admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:16.117428 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:16.118332 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:16.118619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:16.118945 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] PATH_INFO: `/v3/projects/a58d0423e6dc4c9481f0015798fa0511` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:16.120643 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58d0423e6dc4c9481f0015798fa0511)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:16.123350 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:16.171401 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58d0423e6dc4c9481f0015798fa0511', 'request_id': 'req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.177395 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58d0423e6dc4c9481f0015798fa0511', 'request_id': 'req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.186558 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58d0423e6dc4c9481f0015798fa0511', 'request_id': 'req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.197042 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] The token cache is being invalidate because project a58d0423e6dc4c9481f0015798fa0511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:55:16.197323 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.197976 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.199564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1437/2862] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:55:16 2022] DELETE /identity/v3/projects/a58d0423e6dc4c9481f0015798fa0511 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:16.203773 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:16.205264 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:16.218184 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cec7a-d419-4505-9ff7-1864a3e2df22 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:16.275418 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:16.276349 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:16.276601 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:16.276875 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] PATH_INFO: `/v3/users/7b29ba3dc0504922b13f0c43e853c6f6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:16.278115 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b29ba3dc0504922b13f0c43e853c6f6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:16.280103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:16.330121 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b29ba3dc0504922b13f0c43e853c6f6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.342812 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b29ba3dc0504922b13f0c43e853c6f6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.343523 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b29ba3dc0504922b13f0c43e853c6f6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.344131 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b29ba3dc0504922b13f0c43e853c6f6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.350753 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-015af14e-2cfc-47e8-9a7e-dfd9b8dc1ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b29ba3dc0504922b13f0c43e853c6f6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.366166 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1426/2863] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:55:16 2022] DELETE /identity/v3/users/7b29ba3dc0504922b13f0c43e853c6f6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:16.639777 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:16.641263 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:16.653709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbe01d-0b26-47da-ac0c-7a2e66f0cb45 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:16.715539 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:16.716393 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:16.716667 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:16.716937 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] PATH_INFO: `/v3/projects/e202eee2e76c4c3cb019e045ef1ffa79` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:16.718121 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e202eee2e76c4c3cb019e045ef1ffa79)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:16.720095 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:16.767960 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e202eee2e76c4c3cb019e045ef1ffa79', 'request_id': 'req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.774089 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e202eee2e76c4c3cb019e045ef1ffa79', 'request_id': 'req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.782679 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e202eee2e76c4c3cb019e045ef1ffa79', 'request_id': 'req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.793212 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] The token cache is being invalidate because project e202eee2e76c4c3cb019e045ef1ffa79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:55:16.793490 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.794100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f37cdbef-0f90-4f86-8f50-1d6ea554eed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:16.795648 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1438/2864] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:55:16 2022] DELETE /identity/v3/projects/e202eee2e76c4c3cb019e045ef1ffa79 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:16.801736 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deaa96-7644-4b74-9449-2c8773d19c18 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:16.802022 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deaa96-7644-4b74-9449-2c8773d19c18 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:16.802291 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deaa96-7644-4b74-9449-2c8773d19c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:16.819469 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-31deaa96-7644-4b74-9449-2c8773d19c18 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:16.820633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-31deaa96-7644-4b74-9449-2c8773d19c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:16.886134 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1427/2865] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:16.894628 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd65191-687b-40a4-9af6-9940dad63ae0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:16.894912 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd65191-687b-40a4-9af6-9940dad63ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:16.895183 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd65191-687b-40a4-9af6-9940dad63ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:16.914494 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0cd65191-687b-40a4-9af6-9940dad63ae0 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:16.915699 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0cd65191-687b-40a4-9af6-9940dad63ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:16.925315 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1439/2866] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:16.929842 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deaa96-7644-4b74-9449-2c8773d19c18 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:16.940042 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deaa96-7644-4b74-9449-2c8773d19c18 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:16.945877 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:16.946508 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:16.946791 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:16.947070 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:16.947795 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:55:16.948103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:16.949760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:16.961768 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1428/2867] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:55:16.966082 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd65191-687b-40a4-9af6-9940dad63ae0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:16.975629 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd65191-687b-40a4-9af6-9940dad63ae0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:16.981586 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34571-d6d3-4189-a1e3-73799b8ed03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:16.982247 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34571-d6d3-4189-a1e3-73799b8ed03f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:16.982498 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34571-d6d3-4189-a1e3-73799b8ed03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:16.982766 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34571-d6d3-4189-a1e3-73799b8ed03f admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:16.983444 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34571-d6d3-4189-a1e3-73799b8ed03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:16.985450 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34571-d6d3-4189-a1e3-73799b8ed03f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:17.016946 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1440/2868] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:55:16 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:17.021806 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:17.037232 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238b04b-96b2-42eb-a6fe-c344264d2fc8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:17.102706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e68138-8ad7-4629-9fd0-c1d6e7953293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:17.103384 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e68138-8ad7-4629-9fd0-c1d6e7953293 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.103658 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e68138-8ad7-4629-9fd0-c1d6e7953293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.103917 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e68138-8ad7-4629-9fd0-c1d6e7953293 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.104595 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e68138-8ad7-4629-9fd0-c1d6e7953293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:17.106593 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e68138-8ad7-4629-9fd0-c1d6e7953293 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:17.130818 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1429/2869] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:55:17 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:17.135313 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34571-d6d3-4189-a1e3-73799b8ed03f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:17.146289 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34571-d6d3-4189-a1e3-73799b8ed03f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:17.152017 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29db60e-b400-40db-aec4-0d7201456ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:17.152723 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db60e-b400-40db-aec4-0d7201456ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.153001 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db60e-b400-40db-aec4-0d7201456ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.153281 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db60e-b400-40db-aec4-0d7201456ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.154044 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29db60e-b400-40db-aec4-0d7201456ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:17.155664 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29db60e-b400-40db-aec4-0d7201456ad6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:17.166730 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1441/2870] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:17.171083 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e68138-8ad7-4629-9fd0-c1d6e7953293 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:17.181664 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e68138-8ad7-4629-9fd0-c1d6e7953293 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:17.186613 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76c208-e341-4d5f-8d17-a7cb2eefc309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:17.187263 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c208-e341-4d5f-8d17-a7cb2eefc309 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.187545 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c208-e341-4d5f-8d17-a7cb2eefc309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.187819 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c208-e341-4d5f-8d17-a7cb2eefc309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.188547 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76c208-e341-4d5f-8d17-a7cb2eefc309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:17.190177 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76c208-e341-4d5f-8d17-a7cb2eefc309 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:17.200987 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1430/2871] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:17.205216 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29db60e-b400-40db-aec4-0d7201456ad6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:17.215427 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29db60e-b400-40db-aec4-0d7201456ad6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:17.220226 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:17.221093 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.221365 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.221669 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] PATH_INFO: `/v3/projects/b6ef97cef0f94f108bb4c64659d1e562/users/13172f42f2494c1b82b32cb1b9e1c13a/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.235843 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ef97cef0f94f108bb4c64659d1e562, user_id=13172f42f2494c1b82b32cb1b9e1c13a, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:17.238642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:17.255726 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1442/2872] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:17 2022] PUT /identity/v3/projects/b6ef97cef0f94f108bb4c64659d1e562/users/13172f42f2494c1b82b32cb1b9e1c13a/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:17.271868 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9630de-bc07-4215-8bbb-911c9402e03e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.272360 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9630de-bc07-4215-8bbb-911c9402e03e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.272474 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9630de-bc07-4215-8bbb-911c9402e03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.301706 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8e9630de-bc07-4215-8bbb-911c9402e03e None None] MFA Rules not processed for user `13172f42f2494c1b82b32cb1b9e1c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:17.303011 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8e9630de-bc07-4215-8bbb-911c9402e03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:17.389317 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1431/2873] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:17.402396 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:17.404564 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:17.472161 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390fcfd-ee24-4101-9270-3d9505cf6075 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:17.476642 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82d4a1-740c-4ab1-aa02-9c12a926986c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:17.477282 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82d4a1-740c-4ab1-aa02-9c12a926986c service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.477568 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82d4a1-740c-4ab1-aa02-9c12a926986c service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.477855 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82d4a1-740c-4ab1-aa02-9c12a926986c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.487208 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82d4a1-740c-4ab1-aa02-9c12a926986c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:17.488619 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82d4a1-740c-4ab1-aa02-9c12a926986c service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:17.498146 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1443/2874] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:17.519799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9630de-bc07-4215-8bbb-911c9402e03e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:17.588799 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9630de-bc07-4215-8bbb-911c9402e03e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:17.595013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:17.595939 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.596211 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.596518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] PATH_INFO: `/v3/users/13172f42f2494c1b82b32cb1b9e1c13a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.597910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13172f42f2494c1b82b32cb1b9e1c13a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:17.600002 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:17.662308 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13172f42f2494c1b82b32cb1b9e1c13a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:17.673951 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13172f42f2494c1b82b32cb1b9e1c13a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:17.674671 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13172f42f2494c1b82b32cb1b9e1c13a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:17.675329 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13172f42f2494c1b82b32cb1b9e1c13a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:17.682438 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13172f42f2494c1b82b32cb1b9e1c13a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:17.698683 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1432/2875] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:55:17 2022] DELETE /identity/v3/users/13172f42f2494c1b82b32cb1b9e1c13a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:17.703609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8150608-eb49-4f72-aa9b-baf5a2dce538 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.703890 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8150608-eb49-4f72-aa9b-baf5a2dce538 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.704163 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8150608-eb49-4f72-aa9b-baf5a2dce538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.722150 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d8150608-eb49-4f72-aa9b-baf5a2dce538 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:17.723408 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d8150608-eb49-4f72-aa9b-baf5a2dce538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:17.786925 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1444/2876] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:55:17.797718 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:17.799385 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:17.860370 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79196d1-824d-452a-b825-e5964f63e8a7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:17.865128 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e3ee9-82b0-422c-b475-d5a946eb121b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:17.865824 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3ee9-82b0-422c-b475-d5a946eb121b service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:17.866103 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3ee9-82b0-422c-b475-d5a946eb121b service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:17.866358 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3ee9-82b0-422c-b475-d5a946eb121b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:17.877823 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e3ee9-82b0-422c-b475-d5a946eb121b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:17.880024 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e3ee9-82b0-422c-b475-d5a946eb121b service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:17.894552 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1433/2877] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:18.205649 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8150608-eb49-4f72-aa9b-baf5a2dce538 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:18.208612 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d8150608-eb49-4f72-aa9b-baf5a2dce538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:18.223842 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8150608-eb49-4f72-aa9b-baf5a2dce538 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:18.233387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:18.233387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.233387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.233387 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] PATH_INFO: `/v3/projects/b6ef97cef0f94f108bb4c64659d1e562` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.234933 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ef97cef0f94f108bb4c64659d1e562)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:18.236883 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:18.287927 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ef97cef0f94f108bb4c64659d1e562', 'request_id': 'req-c7babe02-987f-48d4-adbc-bb144f5d2b3d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:18.297196 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ef97cef0f94f108bb4c64659d1e562', 'request_id': 'req-c7babe02-987f-48d4-adbc-bb144f5d2b3d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:18.308528 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ef97cef0f94f108bb4c64659d1e562', 'request_id': 'req-c7babe02-987f-48d4-adbc-bb144f5d2b3d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:18.325641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] The token cache is being invalidate because project b6ef97cef0f94f108bb4c64659d1e562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:55:18.325641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:18.325641 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c7babe02-987f-48d4-adbc-bb144f5d2b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:18.327100 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1445/2878] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:55:18 2022] DELETE /identity/v3/projects/b6ef97cef0f94f108bb4c64659d1e562 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:18.334776 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2824696-9b04-46c0-b558-2c882b5083d9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.335326 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2824696-9b04-46c0-b558-2c882b5083d9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.335436 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2824696-9b04-46c0-b558-2c882b5083d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.359476 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b2824696-9b04-46c0-b558-2c882b5083d9 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:18.360046 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b2824696-9b04-46c0-b558-2c882b5083d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:18.439565 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1434/2879] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:18.447772 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7eda1-0f76-4a59-a1e0-3d0f0c3fd200 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.448054 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7eda1-0f76-4a59-a1e0-3d0f0c3fd200 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.448342 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7eda1-0f76-4a59-a1e0-3d0f0c3fd200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.466362 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3bb7eda1-0f76-4a59-a1e0-3d0f0c3fd200 None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:18.467536 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3bb7eda1-0f76-4a59-a1e0-3d0f0c3fd200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:18.476098 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1446/2880] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:55:18.480391 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2824696-9b04-46c0-b558-2c882b5083d9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:18.490653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2824696-9b04-46c0-b558-2c882b5083d9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:18.495653 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:18.496294 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.496566 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.496830 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.497572 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:55:18.497878 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:18.499475 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:18.512013 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1435/2881] 10.222.0.58 () {58 vars in 1152 bytes} [Mon May 16 17:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:55:18.516683 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7eda1-0f76-4a59-a1e0-3d0f0c3fd200 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:18.526465 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7eda1-0f76-4a59-a1e0-3d0f0c3fd200 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:18.531814 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be5cf-ed1e-445a-877f-32b74f8ffe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:18.532483 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be5cf-ed1e-445a-877f-32b74f8ffe4e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.532761 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be5cf-ed1e-445a-877f-32b74f8ffe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.533030 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be5cf-ed1e-445a-877f-32b74f8ffe4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.533778 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be5cf-ed1e-445a-877f-32b74f8ffe4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:18.535725 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be5cf-ed1e-445a-877f-32b74f8ffe4e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:18.564609 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1447/2882] 10.222.0.58 () {60 vars in 1152 bytes} [Mon May 16 17:55:18 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:55:18.571403 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:18.584659 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b588ff-6149-421a-8560-32695d2be23e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:18.644220 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91c48a-a2e8-401b-9cc3-10b24ec03bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:18.644919 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91c48a-a2e8-401b-9cc3-10b24ec03bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.645192 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91c48a-a2e8-401b-9cc3-10b24ec03bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.645447 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91c48a-a2e8-401b-9cc3-10b24ec03bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.646162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91c48a-a2e8-401b-9cc3-10b24ec03bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:18.648119 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91c48a-a2e8-401b-9cc3-10b24ec03bd5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:18.670229 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1436/2883] 10.222.0.58 () {60 vars in 1143 bytes} [Mon May 16 17:55:18 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:55:18.674782 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be5cf-ed1e-445a-877f-32b74f8ffe4e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:18.690531 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be5cf-ed1e-445a-877f-32b74f8ffe4e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:18.697417 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaa26a-226c-4bd0-9794-cbee6819765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:18.698221 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaa26a-226c-4bd0-9794-cbee6819765d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.698500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaa26a-226c-4bd0-9794-cbee6819765d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.698774 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaa26a-226c-4bd0-9794-cbee6819765d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.699635 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaa26a-226c-4bd0-9794-cbee6819765d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:18.702391 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaa26a-226c-4bd0-9794-cbee6819765d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:18.716195 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1448/2884] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:55:18.721330 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91c48a-a2e8-401b-9cc3-10b24ec03bd5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:18.736080 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91c48a-a2e8-401b-9cc3-10b24ec03bd5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:18.741645 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107fd3-d62a-4748-82bb-60a6e9eb61e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:18.742309 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107fd3-d62a-4748-82bb-60a6e9eb61e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.742590 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107fd3-d62a-4748-82bb-60a6e9eb61e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.743351 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107fd3-d62a-4748-82bb-60a6e9eb61e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.744587 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107fd3-d62a-4748-82bb-60a6e9eb61e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:18.746275 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107fd3-d62a-4748-82bb-60a6e9eb61e7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:18.757733 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1437/2885] 10.222.0.58 () {58 vars in 1121 bytes} [Mon May 16 17:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:55:18.762251 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaa26a-226c-4bd0-9794-cbee6819765d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:18.772786 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaa26a-226c-4bd0-9794-cbee6819765d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:18.778076 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:18.778955 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.779230 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.779500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] PATH_INFO: `/v3/projects/77a9826df6b04b23897804133961822a/users/d7afe9c81b70421cafcb2989605b3350/roles/c9deaccdca814832a7d143419fd1d54f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.794893 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a9826df6b04b23897804133961822a, user_id=d7afe9c81b70421cafcb2989605b3350, role_id=c9deaccdca814832a7d143419fd1d54f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:18.797658 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:18.814673 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1449/2886] 10.222.0.58 () {60 vars in 1482 bytes} [Mon May 16 17:55:18 2022] PUT /identity/v3/projects/77a9826df6b04b23897804133961822a/users/d7afe9c81b70421cafcb2989605b3350/roles/c9deaccdca814832a7d143419fd1d54f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:18.826106 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abea3e-36b3-4550-b663-9731e2c3d8ae None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:18.826437 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abea3e-36b3-4550-b663-9731e2c3d8ae None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:18.826794 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abea3e-36b3-4550-b663-9731e2c3d8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:18.854234 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-26abea3e-36b3-4550-b663-9731e2c3d8ae None None] MFA Rules not processed for user `d7afe9c81b70421cafcb2989605b3350`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:18.855426 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-26abea3e-36b3-4550-b663-9731e2c3d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:18.930297 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1438/2887] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:18.941668 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:18.943709 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:19.002249 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8051b0-2888-4ca8-aebb-363cfedf1cf0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:19.006366 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482d764-d4c7-4b94-b275-e5e226ef247e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0ca8aafef94f3399c92a91f5bff1ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:19.006993 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482d764-d4c7-4b94-b275-e5e226ef247e service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:19.007274 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482d764-d4c7-4b94-b275-e5e226ef247e service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:19.007555 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482d764-d4c7-4b94-b275-e5e226ef247e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:19.017063 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482d764-d4c7-4b94-b275-e5e226ef247e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:19.018108 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482d764-d4c7-4b94-b275-e5e226ef247e service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:19.027318 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1450/2888] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:29.094713 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abea3e-36b3-4550-b663-9731e2c3d8ae None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:29.159123 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abea3e-36b3-4550-b663-9731e2c3d8ae None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:29.164010 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:29.164870 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:29.165162 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:29.165682 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] PATH_INFO: `/v3/users/d7afe9c81b70421cafcb2989605b3350` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:29.167000 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7afe9c81b70421cafcb2989605b3350)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:29.168912 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:29.216910 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7afe9c81b70421cafcb2989605b3350'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.228858 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7afe9c81b70421cafcb2989605b3350'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.229633 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7afe9c81b70421cafcb2989605b3350'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.230181 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7afe9c81b70421cafcb2989605b3350'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.236895 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7afe9c81b70421cafcb2989605b3350'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.252429 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1439/2889] 10.222.0.58 () {58 vars in 1223 bytes} [Mon May 16 17:55:29 2022] DELETE /identity/v3/users/d7afe9c81b70421cafcb2989605b3350 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:55:29.258186 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ca08-9fe4-489a-b4e8-617c3d46af4b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:29.258749 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ca08-9fe4-489a-b4e8-617c3d46af4b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:29.258869 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8ca08-9fe4-489a-b4e8-617c3d46af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:29.280175 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c9e8ca08-9fe4-489a-b4e8-617c3d46af4b None None] MFA Rules not processed for user `4463e4c93e664f46a81171f07eadb93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:55:29.281379 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c9e8ca08-9fe4-489a-b4e8-617c3d46af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:29.345162 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1451/2890] 10.222.0.58 () {58 vars in 957 bytes} [Mon May 16 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:55:29.355315 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:29.356760 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:29.412945 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252f6eb-26fd-4b1a-996d-7909a47a778c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:29.417579 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fddf039f65a4cff95c9c2041dd81ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:29.418240 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:29.418518 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:29.418786 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:29.430509 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:29.435048 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:29.445843 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1440/2891] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:55:29.720729 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8ca08-9fe4-489a-b4e8-617c3d46af4b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:55:29.725334 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c9e8ca08-9fe4-489a-b4e8-617c3d46af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:55:29.734598 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8ca08-9fe4-489a-b4e8-617c3d46af4b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:55:29.739405 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4463e4c93e664f46a81171f07eadb93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7c1a113cb54758aa563ff3298e430c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:55:29.740262 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:55:29.740540 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:55:29.740812 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] PATH_INFO: `/v3/projects/77a9826df6b04b23897804133961822a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:55:29.742125 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a9826df6b04b23897804133961822a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:55:29.744025 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:55:29.789827 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a9826df6b04b23897804133961822a', 'request_id': 'req-e0f466f8-3857-4772-bfa7-38e5331720d9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.795972 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a9826df6b04b23897804133961822a', 'request_id': 'req-e0f466f8-3857-4772-bfa7-38e5331720d9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.804475 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a9826df6b04b23897804133961822a', 'request_id': 'req-e0f466f8-3857-4772-bfa7-38e5331720d9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.821255 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] The token cache is being invalidate because project 77a9826df6b04b23897804133961822a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:55:29.821783 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.822795 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e0f466f8-3857-4772-bfa7-38e5331720d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:55:29.825500 dv-cinder-837699-6-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1452/2892] 10.222.0.58 () {58 vars in 1232 bytes} [Mon May 16 17:55:29 2022] DELETE /identity/v3/projects/77a9826df6b04b23897804133961822a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:58:18.529037 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:58:18.530697 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:58:18.605586 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020793e-0908-4017-8332-63f52ec9daf3 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:58:18.667406 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24887a9b-81b9-4f07-939d-2941ac242fd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02938c77178a4f14a33ff1298775687c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e6c3d22278c4adc865f69d685d6fb5c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:58:18.668034 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887a9b-81b9-4f07-939d-2941ac242fd4 service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:58:18.668316 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887a9b-81b9-4f07-939d-2941ac242fd4 service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:58:18.668583 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887a9b-81b9-4f07-939d-2941ac242fd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:58:18.670624 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-24887a9b-81b9-4f07-939d-2941ac242fd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:58:18.685183 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24887a9b-81b9-4f07-939d-2941ac242fd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:58:18.686844 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24887a9b-81b9-4f07-939d-2941ac242fd4 service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:58:18.703861 dv-cinder-837699-6-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1441/2893] 10.222.0.58 () {60 vars in 1365 bytes} [Mon May 16 17:58:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)